Black immigrants have been left out of policy decisions for too long, organizers say