WordPress being strange
Something is screwed up with how I’ve got wordpress installed. I’ve switched it backing to using the ugly permalinks for now, because the nice looking ones cause it to serve up RSS everytime. Still investigating, but at least things work now.
If anyone has had this problem, please comment!