Tip: if you’re looking for a more in-depth mathematical comparison of the optimizers, check out this fantastic blog post by…

Continue Reading# rate

## Understanding the Mathematics behind Gradient Descent.

Because the squared differences make it easier to derive a regression line. Indeed, to find that line we need to…

Continue Reading## Hyper-parameter Tuning Techniques in Deep Learning

Hyper-parameter Tuning Techniques in Deep LearningThe process of setting the hyper-parameters requires expertise and extensive trial and error. There are no…

Continue Reading## Bank Loan Default Prediction

Bank Loan Default PredictionTianhao WuBlockedUnblockFollowFollowingMar 14IntroductionLoans are usually one of the most important products of a bank. Acting as a…

Continue Reading## Checklist for debugging neural networks

Erik Rippel has a great, colorful post on ‘Visualizing parts of Convolutional Neural Networks using Keras and Cats’4. Diagnose parametersNeural…

Continue Reading## Day 2: Bag of Tricks for Image Classification with Convolutional Neural Networks

Day 2: Bag of Tricks for Image Classification with Convolutional Neural NetworksFrancisco InghamBlockedUnblockFollowFollowingMar 11Up-to-date tricks to boost your CNN’sTrick or treat,…

Continue Reading## Optimizing Your Chances of Medical School Admission

But Can we Fit Models to Them?Now that we some idea of the trends in admit rate based on GPA and…

Continue Reading## Guide to choosing Hyperparameters for your Neural Networks

Guide to choosing Hyperparameters for your Neural NetworksKaushik BokkaBlockedUnblockFollowFollowingFeb 18https://www. wired. com/2016/12/2016-year-deep-learning-took-internet/In recent times, Deep Learning has created a significant impact…

Continue Reading## Real-time Multi-Facial attribute detection using computer vision and deep learning with FastAI and OpenCV

Real-time Multi-Facial attribute detection using computer vision and deep learning with FastAI and OpenCVA quick 4 part walkthrough on doing real-time…

Continue Reading## Deep Multi-Task Learning – 3 Lessons Learned

We could tune a separate learning rate for each of the “heads” (task-specific subnets), and another rate for the shared…

Continue Reading## Near-Real-Time Hardware Failure Rate Estimation with Bayesian Reasoning

Assuming a constant true failure rate λ, the number of failures per time follows a Poisson distribution, Poisson(λ), just as…

Continue Reading## Forecasting Interest Rates — Mean Reverting Drift Term Structure Models

Forecasting Interest Rates — Mean Reverting Drift Term Structure ModelsHow Mean Reverting Drift Term Structure Models Can Evolve Interest RatesFarhad MalikBlockedUnblockFollowFollowingFeb 5This article…

Continue Reading## Arrival Rate Bias in A/B Testing

Arrival Rate Bias in A/B TestingGood Things Come to Those Who Can’t Wait, Part 1Daniel McAuleyBlockedUnblockFollowFollowingSep 28, 2018This post was coauthored with…

Continue Reading## From prediction to decision making

From prediction to decision makingWhy your predictions might be falling short — opinionKristofer Rolf SöderströmBlockedUnblockFollowFollowingJan 23Photo by Mika Baumeister on Unsplash“There are a number…

Continue Reading## Understand the Impact of Learning Rate on Model Performance With Deep Learning Neural Networks

Deep learning neural networks are trained using the stochastic gradient descent optimization algorithm. The learning rate is a hyperparameter that…

Continue Reading## How to Configure the Learning Rate Hyperparameter When Training Deep Learning Neural Networks

The weights of a neural network cannot be calculated using an analytical method. Instead, the weights must be discovered via…

Continue Reading## How to Develop a Snapshot Ensemble Deep Learning Neural Network in Python With Keras

Model ensembles can achieve lower generalization error than single models but are challenging to develop with deep learning neural networks…

Continue Reading## Building a Data Pipeline with Airflow

$ psql rates CREATE TYPE USD_PAIR AS ENUM ( 'AED', 'AFN', 'ALL', 'AMD', 'ANG', 'AOA', 'ARS', 'AUD', 'AWG', 'AZN', 'BAM',…

Continue Reading## Flower classification with Convolutional Neural Networks.

We will then calculate predictions for all these images, take the average, and make that our final prediction.log_preds,y = learn.TTA()probs…

Continue Reading## Bag of Tricks for Image Classification with Convolutional Neural Networks in Keras

The warmup strategy increases the learning rate from 0 to the initial learning rate linearly during the initial N epochs…

Continue Reading## What Dog Breed is That?

The initial red layers will have small learning rate as we don’t want to disturb them much, the middle blue…

Continue Reading## Dog Breed Identification

The initial red layers will have small learning rate as we don’t want to disturb them much, the middle blue…

Continue Reading## Building a Skin Lesion Classification Web App

After adding a fully connected layer and through only training the last few layers, we obtain a model that can…

Continue Reading## Forecasting USD-MNT Exchange Rate — Part 1: Prophet

Source: Wikimedia CommonsForecasting USD-MNT Exchange Rate — Part 1: ProphetA time series analysis of the Mongolian TugrikRobert RitzBlockedUnblockFollowFollowingDec 3Living in a developing country…

Continue Reading