Leto, 42, said that they escaped from the place at an early age because it was oppressive, reported Contactmusic.
"We escaped early on. It's very oppressive. We would go back for the summers and stay with our grandmother, though. So the culture was always there that we returned to.
"We moved around every couple of years growing up. Way up to north Massachusetts. Everywhere. But no matter where we were it was a very creative environment around artists. That is obviously an important reason that Shannon (brother) and I are pursuing the path that we are now," he said.
"I don't think we'd care at all. We certainly identify with people who are different.