"It is a huge loss for my staff and my factory. This is the first time we have ever (had) a fire at one of my seven factories," he said after the blaze on Saturday evening.
He denied that the factory had been unsafe.
Bangladesh has recently emerged as the world's second-largest clothes exporter with overseas garment sales topping $19 billion last year, or 80 percent of total national exports.
The sector is the mainstay of the poverty-stricken country's economy, employing 40 percent of its industrial workforce.