Into the Unknown - Bridging the gap between data and information

Categories

All (46)

ANOVA (1)

API (1)

Apache Spark (1)

Audio (1)

BigQuery (6)

Biomedical (1)

Blogging (1)

CLV (1)

Chi-Square (1)

Collaborative Filtering (1)

Convolutional Neural Networks (1)

Cross-Entropy (1)

Dash (1)

Data Carpentry (3)

Data Cleansing (1)

Data Lakes (2)

Data Science (1)

DataCamp (6)

DataTalksClub (9)

Database (1)

Dataproc (1)

Docker (1)

ETL (2)

Ensembling (1)

Forecasting (1)

GCP (3)

GCS (1)

Geospatial (2)

GoogleSheets (1)

Gradient Accumulation (1)

Hugging Face (1)

Image (2)

Imbalanced data (1)

JSON (1)

K-means (1)

Kaggle (2)

LDA (1)

Logistic Regression (1)

Looker (2)

MLOps (3)

Marketing (1)

MongoDB (1)

Multi-Label (1)

My Journey (1)

NumPy (1)

Numpy (1)

OSM (1)

PostgreSQL (1)

Power BI (1)

Prefect (3)

Projects (3)

Python (3)

Quarto (1)

Random Forests (1)

SMOTE (1)

SQL (1)

SciPy (1)

Segmentation (1)

Spark (1)

T-test (1)

TIL (8)

Tableau (1)

Terraform (2)

Text mining (1)

Tukey's Range (1)

Uber H3 (1)

W&B (1)

XGBoost (1)

dbt (2)

fastai (10)

librosa (1)

pandas (2)

parkrun (1)

seaborn (2)

timm (1)

vision (1)

Fraud Detection using Python

Imbalanced data

Customer Lifetime Value (CLV)

My starting point for this project is to frame two common business problems faced by the Google Merchandise Store and ecommerce businesses in general.

Hypotheses Testing

`Dec 7, 2023`{=html}

MongoDB - The Basics

If you are conversant with Python and prefer the JSON format to the tabular data (rows and columns) approach used by SQL then MongoDB mi…

Urban Accessibility - How close is my nearest Żabka ?

This project leans heavily on the methodologies used by Milan Janosov in Urban Accessibility — How to Reach Defibrillators on Time. His articles are a true…

Google Sheets API Connector

In this tutorial I will show you how to access real-time (historical data behind a paywall) flight status, airports, airlines and aircraft data using the aviationstack API. I will also…

mlops-zoomcamp | Module 3: Orchestration

Weights and Biases

In this blog we will cover how to visualize metrics while training models, how…

Power BI

Outside of Excel spreadsheets, my first…

mlops-zoomcamp | Module 2: Experiment tracking and model management

Spreadsheets are a familiar tool and widely used across different industries. Many people are already…

parkrun Kraków 20/05/2023 | #461

A couple of weeks ago I signed up for parkrun Kraków. I had a dry run on 6 May, just to see how it all worked. There was a bit of a…

mlops-zoomcamp | Module 1: Introduction

Jupyter Notebooks offer a convenient and interactive environment for experimentation, prototyping, and data exploration in machine learning projects. However, when…

Biomedical Image Analysis in Python

Since the first x-ray in 1895, medical imaging technology has advanced clinical care and opened up new fields of scientific investigation. The amount of imaging data is…

Data Engineering Zoomcamp - Final Project

It’s time to…

Data Engineering Zoomcamp - Week 5

Computerized batch processing is a method of running software programs called jobs in batches automatically. While users are required to submit the jobs, no other…

Data Engineering Zoomcamp - Week 4

Goal: Transforming the data previously loaded in to our data warehouse (in my case BigQuery) by building models using a dbt project, testing and deploying those models in a production environment…

Data Engineering Zoomcamp - Week 3

A Data Warehouse is an OLAP solution used for reporting and data analysis and generally includes raw, meta and summary data.

Data Engineering Zoomcamp - Week 2

Just like a physical transport logistics system, it is important to have a smooth data logistics system. This process is also known as Workflow Orchestration. Workflow orchestration allows us to turn any code into a workflow that we can…

Data Engineering Zoomcamp - Week 1

This course will cover a number of technologies, including Google Cloud Platform (GCP): Cloud-based auto-scaling platform by Google, Google Cloud Storage (GCS): Data Lake…

Tableau

Tableau is a widely used business intelligence (BI) and analytics software trusted by companies like Amazon, Experian, and Unilever to explore, visualize, and securely share…

Credit Risk Modeling in Python

Logistic Regression

If you’ve ever applied for a credit card or loan, you know that financial firms process your information before making a decision. This is because giving you a loan can have…

Financial Forecasting in Python

In Financial Forecasting in Python, we will step into the role of CFO and learn how to advise a board of directors on key metrics while building a financial forecast, the basics of income statements and…

Convolutional Neural Networks (CNNs)

Convolutional Neural Networks

This is my follow up to the second half of Lesson 8: Practical Deep Learning for Coders 2022 in which Jeremy demonstrates the inner workings of a Conv…

Collaborative Filtering

Collaborative Filtering

This is my follow up to the second part of Lesson 7: Practical Deep Learning for Coders 2022 in which Jeremy shows how to build a…

Multi-label classification

This blog further develops the ideas included in the earlier Paddy Dcotor: Paddy Disease Classification blog. We’re going to build a model that doesn’t just predict what disease the rice paddy has, but also predicts what kind of rice is shown. This…

Scaling up

Gradient Accumulation

This is my follow up to the first part of Lesson 7: Practical Deep Learning for Coders 2022 in which Jeremy introduces a technique known as Gradient Accumulation which allows us to train larger models, despite apparent…

Paddy Doctor: Paddy Disease Classification

This is my follow up to the second part of Lesson 6: Practical Deep Learning for Coders 2022 in which Jeremy walks us through his approach to…

Kaggle

In order to download datasets from Kaggle when working outwith the Kaggle environment you will need to make use of a Kaggle API. You can get this by clicking on Account below your profile name, and then…

Random Forests

This is my follow up to the first part of Lesson 6: Practical Deep Learning for Coders 2022 in which Jeremy introduces Decision Trees and Random Forests.

Seaborn Tutorial

There is no universally best way to visualize data. Different questions are best answered by different plots. Seaborn makes it easy to switch between different visual representations by using a consistent…

Numpy Tutorial

NumPy is the fundamental package for scientific computing in Python. It is a Python library that provides a multidimensional array object, various derived objects (such as…

Efficient Pandas

Having code that is clean, readable and has a logical flow is invaluable. I discovered Structured Query Language (SQL) before Python, and as the name suggests, this already…

Image Processing with Python

As computer systems have become faster and more powerful, and cameras and other imaging systems have become commonplace in many other areas of life, the need has grown for…

Programming with Python

This blog has been produced after working through the Programming with Python lessons provided by Data Carpentry.

Introduction to Geospatial Raster and Vector data with Python

This blog has been produced after working through the Introduction to Geospatial Raster and Vector data with Python lesson provided by Data Carpentry.

Audio Feature Extraction

In this blog…

Name that Genre

What is Spark, anyway?

I’ve noticed that Apache Spark is cited as a requirement on many data science job specs. My natural curiosity led me to the Introduction to PySpark course available through DataC…

Wisła Kraków vs. KS Cracovia

I arrived in Kraków a few months back and during my wanderings I noticed two football stadiums on either side of Błonia separated by just 700 metres. I didn’t know anything about either of these clubs but was told that the rivalry between them is intense. The so-called Holy War between Wisła…

FIFA World Cup - Qatar 2022

At the time of writing the 2022 World Cup is already underway, with 32 teams…

Excelosaurus meets Python

This is my follow up to Lesson 5: Practical Deep Learning for Coders 2022 in which Jeremy builds a linear regresson model and neural net from scratch using Python.

Excelosaurus

This is my follow up to Lesson 3: Practical Deep Learning for Coders 2022 in which Jeremy built a linear regression…

Huggy Bear

This is my follow up to Lesson 2: Practical Deep Learning for Coders 2022 in which Jeremy created a dog | cat classifier model and deployed to Hugging Face. During this project I will try to replicate on an image classification model, which…

Cat or Dog?

This is my follow up to Lesson 1: Practical Deep Learning for Coders 2022 taught by Jeremy Howard, co-founder, along with Dr. Rachel Thomas, of fast.ai. This is my first attempt at…

Hello, World!

Hello world! This is all very new to me.

Introducing….

….wait for it!