This paper discusses about hand gesture recognition for disaster management like mining. In mining places, so many workers are always in danger situation. If the mine falls down suddenly then working people would be under the coal. If anyone is alive, but not able be to communicate with the rescue team in this situation working people may be dead. For saving their lives the proposed system provides facility to the working people send the information through hand gesture to rescue office. The proposed system is designed to recognize hand gestures using simple color feature extraction algorithm. After extracting the color feature of the test and training images we calculated the Euclidian distance to recognize the hand gesture. Finally, the recognized gesture image corresponding text can be converted into speech.