Firefighters from Central, Birley Moor, Rivelin and Parkway fire stations were called out to the blaze on Irving Street, Darnall, just after 10am yesterday.
A fire service spokesman said the fire was believed to have started accidentally.
Firefighters were on the scene until 1.20pm.
One local businessman said he believed the burning building was unused, and added it did not disrupt trade on nearby Staniforth Road.
It was one of a number of fires over the weekend.
Three fire crews from Birley Moor, Parkway and Central stations were called out to a deliberate skip fire at 6.20pm on Saturday on Sheffield Road, Hackenthorpe, Sheffield. The crew came away at 7.15pm.
And firefighters from Central fire station were sent to put out a car fire on John Street, near Bramall Lane, at 5.35pm the same evening.