PinnedPublished inDunzoDebugging Airflow Issues: A Case StudyAt Dunzo, we are using Apache Airflow in the data platform to orchestrate multiple types of pipelines.Jul 17, 2023Jul 17, 2023
PinnedPublished inPolar TropicsRamblings of a broken heartWhy did you meet me, love me and leave me?Feb 12, 2017Feb 12, 2017
Published inPolar TropicsGreat Expectations — The Good and the BadRecently, I got the opportunity to use the data validation library Great Expectations. Like its literature counterpart, it has the…Jan 24, 20221Jan 24, 20221
Published inPolar TropicsSetting up HTTPS using a letsencrypt wildcard certificate on a private domain/IPRecently, I was setting up a service on Nginx on Google Cloud Platform. My organisation has started using the google cloud and I wanted to…Jan 14, 20211Jan 14, 20211
Published inPolar TropicsReligion is a birthright and my birthright is better than yours!!Religion. Probably the most frequent word you’ll find dropped in a discussion these days after Covid. After all when we can’t wrap our…Sep 23, 2020Sep 23, 2020
Published inPolar TropicsLife and Experiences of 2-wheeler bike taxis in IndiaIt was a dark and stormy night/day. The iconic line used by Snoopy is a perfect way to describe riding with bike taxis. Whatever…Sep 6, 20192Sep 6, 20192
Published inPolar TropicsHow I exploited Sentry to find sensitive details of customersThe world of security and hackers has always fascinated me and I thought finding bug bounties would be a good way of learning some basic…Jan 29, 2019Jan 29, 2019
Published inPolar TropicsImproving Spark job performance while writing Parquet by 300%A while back I was running a Spark ETL which pulled data from AWS S3 did some transformations and cleaning and wrote the transformed data…Jun 28, 2018Jun 28, 2018