OpenAI's Deep Research tool appears useful for data analysis but often fails on accuracy, providing misleading information. While it saves time compiling data, results require meticulous verification, limiting its effectiveness. The tool is not geared for precise data retrieval, reflecting a broader issue with LLMs—being good at creative tasks but poor at accurate, deterministic ones. There are uncertainties about whether these models will improve sufficiently to become reliable. Overall, while they facilitate research, they still rely heavily on user oversight for accuracy.
https://www.ben-evans.com/benedictevans/2025/2/17/the-deep-research-problem