PinnedPublished inTowards DevBlazing Fast ETLs with Simultaneous MultiProcessing and MultiThreadingHow I got a 66.4x reduction in code execution timeMay 27, 20232May 27, 20232
PinnedFactory Functions: Supercharge your Python codeIf software design, object-oriented programming and code efficiency are things you think about when developing your applications or ETL…Nov 5, 20224Nov 5, 20224
Scala Jobs on AWS Glue: A Practical Guide to Development, Local Testing and DeploymentAs a data engineer I love Spark and use AWS Glue as one of the main platforms to deploy Spark jobs at my company. There are some things…Apr 3Apr 3
Published inAI MindShrink Your News!In the ever-evolving world of data and technology, processing large volumes of text is a significant challenge. Text summarization is a…Jul 30, 2023Jul 30, 2023
Async IO in Python: A Practical Guide to Efficient API CallsFor a Python developer, handling data requests efficiently is crucial when working with large data sets, especially when these requests…Jul 26, 2023Jul 26, 2023
Dataclasses: Supercharge your Python codeWe deal with data-centric objects a lot when we code. I have found that the use of dataclasses to be a very good solution when we deal with…Nov 12, 20226Nov 12, 20226