• QuizzaciousOtter
    link
    fedilink
    English
    arrow-up
    13
    ·
    1 month ago

    I really don’t think that’s a lot either. Nowadays we routinely process terabytes of data.

    • Kausta
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 month ago

      Yeah, it was just a simple example. Although using just pandas (without something like dask) for loading terabytes of data at once into a single dataframe may not be the best idea, even with enough memory.