Kanye West says he's not apologizing for refusing to perform until a wheelchair-bound concertgoer stood up this weekend during his concert ... because the rapper believes HE was the victim.