Look at the Sky and Tell the Weather