Even as authors and publishers celebrated all things literary, politicians were the biggest crowd-pullers at the four-day event