There appeared to be a perception among whites that the commission - which is probing three decades of human rights abuses - was something that did not affect them, he said.
"While I understand that the majority of victims are blacks, this does not affect just one section of the population. It has to do with the nation, reconciliation and forgiveness," Boraine told a media briefing on the first day of the commission's Bloemfontein hearings.
"I think they are shirking their responsibility in not being present at a moment of history in our country.
"If this persists it lessens the potential for reconciliation."
Boraine said he was "particularly distressed" by the almost complete absence of white residents at Tuesday's hearing, which heard tearful tales of torture in detention, deaths in exile and disappearances.
"I would appeal to people who are concerned about developing a human rights culture to make an effort to be present."
His comments were echoed by fellow commissioner Khoza Mgojo, who said the commission hearings were an opportunity for whites to come and listen "in a free spirit about what has been happening".
"We need these people. There is no need for them to fear anything. We are one nation, but this thing is dividing us."