PinnedPublished inTowards DevBlazing Fast ETLs with Simultaneous MultiProcessing and MultiThreadingHow I got a 66.4x reduction in code execution timeMay 27, 20232May 27, 20232
PinnedFactory Functions: Supercharge your Python codeIf software design, object-oriented programming and code efficiency are things you think about when developing your applications or ETL…Nov 5, 20224Nov 5, 20224
Scala Jobs on AWS Glue: A Practical Guide to Development, Local Testing and DeploymentAs a data engineer I love Spark and use AWS Glue as one of the main platforms to deploy Spark jobs at my company. There are some things…Apr 3, 2024Apr 3, 2024
Published inAI MindShrink Your News!In the ever-evolving world of data and technology, processing large volumes of text is a significant challenge. Text summarization is a…Jul 30, 2023Jul 30, 2023
Async IO in Python: A Practical Guide to Efficient API CallsFor a Python developer, handling data requests efficiently is crucial when working with large data sets, especially when these requests…Jul 26, 2023Jul 26, 2023
Dataclasses: Supercharge your Python codeWe deal with data-centric objects a lot when we code. I have found that the use of dataclasses to be a very good solution when we deal with…Nov 12, 20226Nov 12, 20226
