life is too short for a diary



Posts Tagged “docker”

1 min read

Creating Python AWS lambda layer with Docker

When you develop AWS lambda functions, you might feel the need to install additional `python` libraries. This can be achieved using Lambda layers that can be included in any lambda function...

Continue reading → docker aws python



1 min read

Debugging Spark Application Locally using remote container

One of the nifty feature in any code development is the ability to debug your application using break points. Submitting a Spark job while waiting for it to complete will waste a lot of time debugging. Spark jobs can be debugging with `break points` and `step over` and `step into` and `step out` commands...

Continue reading → spark pyspark docker vscode



3 min read

Connect to an Oracle Database using kerberos with python

Jobs failed! Screamed an automatic failure alert in email inbox. Existing python scripts were failing in the server which fetched data from Oracle database. I wondered if the credentials had changed...

Continue reading → kerberos projects python docker oracle database