Bangladesh has shortage of electricity but has abundance of sunshine. The grid electricity could not reach many areas due to remoteness and inaccessibly. In many rural areas energy needs are met by biomass for cooking and kerosene for lighting purpose. Solar PV has to some extent has provided light in rural Bangladesh. The rural energy access which has immense social benefits has sustained due to vibrant financial management and acceptability by rural people. The financing mechanism and the infrastructure which are the two major factors for the sustainability of rural energy access are discussed in this paper. Our hope that the lesson learned from Bangladesh will be helpful to other developing countries specifically African countries. However, the socio economic condition of this continent needs to be studied in-depth to tailor a successful and economically viable model for rural energy access.