Ethnic and Minority Affairs Broadcasting Act of 1984 - Amends the Communications Act of 1934 to require the Federal Communications Commission to establish the Ethnic and Minority Affairs Office.

Directs the Office to: (1) carry out an educational program that promotes educational ethnic and minority programming and encourages the positive portrayal of ethnic groups in radio and television broadcast programming; (2) receive complaints regarding programming which unfairly depicts ethnic groups; (3) collect and disseminate information about the portrayal of ethnic groups in programming; (4) conduct an annual conference to draw public attention to such portrayal; (5) submit to Congress an annual report on its activities; and (6) provide information on the portrayal of ethnic groups to the Commission for possible consideration in the review of broadcast license applicants.