It happened at an apartment building around 2:30 p.m. Thursday.
Officials say 42-year-old William Tolley was on the roof during routine operations when he fell. He was pronounced dead at a hospital.
Three other people suffered minor injuries.
The fire was brought under control in less than an hour. It was not considered suspicious.
Officials said it was too early to say what caused the 14-year-old veteran to fall. He leaves behind a wife and 8-year-old daughter.
The last New York City firefighter to die in the line of duty happened in September when an explosion at a marijuana grow house in the Bronx killed a fire battalion chief.