Territory’s top official says he was ‘misunderstood’ over his views on low-income voters