• Maggoty@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    7 hours ago

    Just so you know census data is very heavily queried. Everything from civil engineering to economics wants to look at that dataset every day.

    • pixxelkick@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      7 hours ago

      Like I said, in the scale compared to actual high frequency data though, that’s still be infrequent.

      High frequency DBs are on the scale of many queried per second

      Even with tonnes of data scientists and engineers querying the data, that’s still in the scale of queries per minute, which is low frequency in the data world.

      • Maggoty@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        5 hours ago

        I wouldn’t put it past them to experience numbers in the per second realm, especially as new data posts and everyone is rushing to grab it.