Speedup your pandas data analysis using FireDucks

[qsourav]

Title of the talk

Speedup your pandas data analysis using FireDucks

Description

The Pandas library, being the top choice among Data Scientists, many legacy applications developed using this library related to data preparation are in high demand for optimization to reduce the performance cost, especially when being executed on the cloud. The existing high-performance pandas alternatives sometime compel a user to learn completely new API syntaxes, whereas some of the others demand paying an extra hardware cost for GPU, etc.

To address the same, we at NEC R&D Lab, have developed FireDucks, a solution that’s been crafted for the contemporary data professional who loves pandas and deals with voluminous and complex data on a regular basis. With the promise of highly compatible pandas APIs and the revved-up performance, FireDucks can serve the demands of this digital age and transform the arduous task of data wrangling into a more efficient and less taxing endeavor. It can be simply installed on any Linux system using pip.

Please feel free to check out the website: https://fireducks-dev.github.io

Table of contents

• introduction to FireDucks
• how does FireDucks wok
• evaluation results from some popular benchmarks
• Q/A

Duration (including Q&A)

30-40 mins

Prerequisites

Nothing as such.

Speaker bio

Hello, my name is Sourav Saha. I have 11+ years of professional experience at NEC Corporation in the diverse fields of High-Performance Computing, Distributed Programming, Compiler Design, and Data Science. Currently, my team at NEC R&D Lab, Japan, is researching various data processing-related algorithms. Blending the mixture of different niche technologies related to compiler framework, high-performance computing, and multi-threaded programming, we have developed a Python library named FireDucks with highly compatible pandas APIs for DataFrame-related operations. In my previous engagements, I have worked in research and development of performance critical AI and Big Data solutions, optimization of several legacy applications related to weather prediction, earth-quake simulation etc. written in C++ and Fortran. Looking forward to interacting you with.

• LinkedIn: https://www.linkedin.com/in/sourav-%E3%82%BD%E3%82%A6%E3%83%A9%E3%83%96-saha-%E3%82%B5%E3%83%8F-a5750259/
• Twitter: https://x.com/SouravSaha97589

The talk/workshop speaker agrees to

• Share the slides, code snippets and other material used during the talk

• If the talk is recorded, you grant the permission to release
  the video on PythonPune's YouTube
  channel
  under CC-BY-4.0
  license

• Not do any hiring pitches during the talk and follow the Code
  of
  Conduct

[bhavin192]

Thank you for the proposal @qsourav, just to clarify: will you be able to deliver this talk in-person (Pune)? Or would prefer to do this in our online meetups?

[qsourav]

Hello Bhavin, thank you for your reply. Since I am currently located in Tokyo, I would be able to present the talk only if it is held online. Please feel free to suggest if you have any online meetup planned sometime in coming days.

[vishalvvr]

Hello @qsourav,
This month's PythonPune meetup is scheduled on 28th July 2024, Just wanted to confirm your availability for presenting this talk? (this will be an virtual/online meetup)

Thanks :)

[qsourav]

Hello @vishalvvr,

Thank you for your kind response.

Can you please confirm the timing for the same?

[vishalvvr]

Hello @qsourav,
Oops, forgot to mention the time! My bad.
Meetup will start at 10:30 AM IST (02:00 PM JST).
We are planning to have your talk in the beginning itself.

[qsourav]

Hello @vishalvvr,

Thank you for your kind confirmation.

I am fine with the timing and looking forward to introduce FireDucks and its offerings in PythonPune community.

Thank you once again for this opportunity!

Best Regards,
Sourav Saha

[vishalvvr]

Hey @qsourav,
Awesome! I've just added your talk details to the meetup page [1].
Can't wait to see you there!

[1] https://www.meetup.com/pythonpune/events/302364955

[qsourav]

@vishalvvr, thank you for the update. I am excited too. Looking forward to an interactive session.