Pelosi says although 'the people have spoken', 'the agenda won't change'