He was testifying before the Truth Commission hearing in Pietersburg on Thursday.
Prefacing his testimony, Baloyi urged the commissioners and members of the audience not to "feel painful", because much of the torture inflicted on him happened while he was unconcious.
However, Baloyi did not detail the torture he suffered in prison. Much of his testimony instead focused on his recruitment to the PAC and how the organisation evolved.
Baloyi doggedly ingnored attempts by commissioners to get him to speed up his testimony, and with less than nine minutes of his allotted time remaining gave a very brief account of the assaults he endured.
But in a written submission to the commission, Baloyi said he had been arrested in Johannesburg in March 1965 for furthering the aims of the PAC.
He was interrogated by a Capt van der Berg and Gen van der Berg in Pretoria and was imprisoned at Newlock Prison.
After his trial, in which he was sentenced to three years' imprisonment, Baloyi said he was transferreed to Baviaanspoort Prison and later to Barberton Prison.
Van der Berg had ordered that he should be denied food and kept in solitary confinement, Baloyi said.
"I was offered a full meal one day after every three days for five months."
At Baviaanspoort he was sent to work on the prison farm despite being ill.
He said a prison warder, who Baloyi named as Langerveld and who carried a cane and an iron rod, had assaulted him.
Baloyi claimed the warder had been ordered to do this by a Col Bezuidenhout.
He sustained injuries to his left eardrum which had left him deaf in one ear, he said.
He had also suffered permanent damage to his left eye and right leg, the submission said.
He claimed that after his assault the prison warders hid him in compost and that he was rescued by a fellow inmate.
Baloyi's testimony ended abruptly when he was told by the commission that time had run out and that the hearings would adjourn for lunch.