How do web based trading platforms like Photon, BullX, Axiom get both real-time and historical data for every pair almost instantly?

External question — Solana Stack Exchange Author: alexis Original post: https://solana.stackexchange.com/questions/20249 License: CC BY-SA 4.0 — https://creativecommons.org/licenses/by-sa/4.0/ Adaptation: HTML converted to plain text; contact email addresses removed. Really interested to know this. I know that you can use gRPC to listen to and parse real-time logs, but I am curios as to what tool/service these companies use to fetch complete historical transaction data and convert it to a Candlestick series with almost no delay – on any pair. Thank you for any responses!

External answer — Solana Stack Exchange Author: shutDAFUDup Original post: https://solana.stackexchange.com/a/23144 License: CC BY-SA 4.0 — https://creativecommons.org/licenses/by-sa/4.0/ Adaptation: HTML converted to plain text; contact email addresses removed. I’ve been wondering about this myself. I know gRPC and RPC logs are one route, but I’m not too sure how platforms like Photon or BullX can structure that data so quickly across every pair. It feels like there must be some kind of indexing layer or API service behind it. Curious to see if anyone has more concrete info on this.