Figures from the National Housing Federation have revealed a massive shortfall in the amount of new homes needed.
But Mr Lewis told BBC’s Inside Out programme that his projected plan was one million new homes by 2020.
This comes after a report commissioned by Papworth Trust earlier this year revealed that no more bungalows would be built by the end of the current Parliament if the current downward trend continued.
Vicky McDermott, chief executive of Papworth Trust, said: "We welcome the comments of the housing minister that one million homes will be built by 2020.
“But after our report highlighted the dire need for suitable housing for disabled and older people, we must urge Mr Lewis not to ignore their needs.
“Affordable homes are not enough. Accessible homes must form part of the Government’s thinking to meet the needs of both working age disabled people and of retiring households who increasingly need homes that can adapt to their mobility needs as they age."
In March, the Trust launched two accessible bungalows which occupy the same plot as a standard two-bedroom home.
It is hoped the designs will persuade more developers to explore more options for accessible housing.