According to Jim S05 E17 The Grumpy Guy

Jim gets mad when he finds out that his neighbor Julie has been writing children books and basing them about him.