With “The Fabelmans,” the Oscar-nominated actress moves from minor-key naturalism to more stylized performances: “I wanted to make work that an audience member had to deal with.”