L-layer Neural Network
Quick reference on a generalized network setup based on number of layers
Posts by Tag
- ml 18
- programming 12
- leadership strategy 10
- optimization 10
- reference 9
- product strategy 9
- Javascript 7
- engineering execution 6
- databases 5
- iOS 5
- math 5
- Node.js 4
- product development 4
- DevOps 4
- Swift 4
- engineering strategy 4
- neural networks 4
- opinion 3
- Mongoose.js 3
- Meteor.js 3
- CI/CD 2
- TDD 2
- Mongoose 2
- Reference 2
- vim 2
- Swagger.js 2
- Bluebird.js 2
- Xcode 2
- Objective-C 2
- Android 2
- MongoDB 2
- startup strategy 2
- hyperparameters 2
- class activation mapping 2
- Lyft 1
- Chrome extension 1
- SMS 1
- When.js 1
- Docker 1
- Nginx 1
- Java 1
- jsPDF 1
- ECMAScript 6 1
- human behaviour 1
- ceiling analysis 1
- biomedical engineering 1
- algorithm options 1
- Tensorflow 1
- Keras 1
- ImageNet 1
- saliency maps 1
- class model visualization 1
- neural network 1
- DNNs 1
- overfitting 1
- semantic dictionary 1
- dog 1
ml
Linear Algebra in Machine Learning
Linear Algebra reference especially useful when vectorizing Machine Learning operations and understanding intuition for algorithms
Numerical Gradient Checking for Backprop
Backprop can be error-prone. Numeric methods for calculating the gradient is computational slow but easy to implement
Activation Functions for CNNs, RNNs, DNNs
Knowing which activation functions are available, and how it’s changed over the years, gives us choices for optimization and inspiration for new functions
Classification Model Performance Metrics
Using the following metrics gives a more accurate picture of model performance
Neural Network Interpretability Visually
Understanding the activation of a network with the help of semantic dictionaries and non-neg matrix factorization to increase network performance.
Increase Validation Accuracy in Cases of High Variance
How can we make sure the representation learned by our model will be applicable to data the model has never seen before. Overfitting can reduce the validatio...
Weight Initialization in Deep Neural Networks
A set of strategies for weight initialization preventing DNNs from having problems like vanishing or exploding gradients
Reducing Bias to Increase Test Set Accuracy
Gradient Class Activation Mapping provides a method that can be used to visually explore possible biases in the CNNs and DNNs
Hyperparameter Tuning for Model Optimization
Knowing what hyperparameters are available for tuning is an important part of quickly and accurate optimization
Visual Explanation of Neural Networks via CAM
Understanding the spatially important features of Deep and Convolutional Neural Networks using Class Activation Mapping
Optimizing Models using Saliency Maps and CMVs
Extracting visual insight from network layers allows us to optimize and investigate our models
ImageDataNet: Generator for Training and Validation
Good organization is key when it comes to the performance of our engineering team. When it comes to training and validation of an ML algorithm, there are som...
Choosing an Appropriate ML Algorithm for a Product
Picking the right ML algorithm requires careful consideration of the user, product, team, and business
Hyperparameter Range of Value
Understanding how to iterate through the values of the hyperparameters when tuning a Machine Learning algorithm can make a difference when it comes quickly t...
Do Biomedical Engineers have an Advantage in Machine Learning?
Biomedical engineers go through a multidisciplinary training that might make them a good major to transition into machine learning and Artificial Intelligence
Product Considerations when Incorporating Machine Learning
As will any software engineering field, it’s important to consider technical tradeoffs so that we can maximize customer value.
Ceiling Analysis to Evaluate Optimization Potential
Focusing on the module with the most potential gives direction on where to optimize the model pipeline
programming
SwaggerJS via Swagger-Tools for NodeJS
Learning by examples
Bluebird Promises with Mongoose for MongoDB
Quick examples of using bluebird with mongoose in node. I just want to show you a couple common use cases to help you recognize how to use promises.
Dealing with Complex @IBDesignable
When your @IBDesignable is either too complex or requires data not available when previewing in the interface builder, here is how you deal with those errors.
MPAndroidChart to ios-charts syntax conversion
It turns out that there is enough difference in the properties each framework uses that it can be frustrating to learn how to use the ios-charts library. Her...
Singleton Swiftly
Two design patterns which can be used to implement Singletons in Swift.
Custom NSNumberFormatter
How to create and class a 100% customized NSNumberFormatter in Swift. Useful when frameworks (cough ‘ios-charts’) require a NSNumberFormatter for value forma...
Faster Logical UIScrollView in Swift
UIScrollView is something that can be very confusing because it uses constraints in a way that they aren’t normally used. Because of this there is so much co...
Faster Deploy with MeteorJS
Quickly deploy MeteorJS to your own provider or services like Digital Ocean.
Attributed Strings in Xcode with Custom Font
Attributed strings build in the storyboard editor which use a custom font does not render correctly. Here are the steps to get around it
Transliteration of Promises to Callbacks
Promises seem like an amazing way to take advantage of non-blocking io in a very readable way
Swagger 2.0 Spec File Upload Method
A little information on how to edit your swagger.json document (v2) so that you can accept file uploads in NodeJS. Includes a workaround for a current bug.
Node.js Alternate Config File
An alternate config file in node for setting variables based on current env without the overhead of another library with more flexibility than a .json file.
leadership strategy
The Dichotomy of Leadership
An approach to help leaders recognize and attain leadership balance required for teams
Leaders Eat Last
Simon explores what it means to become a truly admired leader
The 21 Irrefutable Laws of Leadership
A review and summary of one of the foundational startup books.
Good to Great
Defines the leadership style of the 90’s and what can be learned and used in the 20th century
The Power of Positive Leadership
Positive leaders can transform teams and organizations
Washington on Leadership
Washington ‘presented’ as the first founder and CEO of two startups; the army and the presidency.
Lincoln on Leadership
An examination of Lincoln’s leadership abilities and how they can be applied to today.
The Five Dysfunctions of a Team
A quick book review from the perspective of the management of a engineering team.
The Innovators
Most innovations in the digital age were done collaboratively. This is the story of why their ability to work as a team made them so creative and successful
Smarter Faster Better
Focusing on how you think is more important in productivity than what you think
optimization
Activation Functions for CNNs, RNNs, DNNs
Knowing which activation functions are available, and how it’s changed over the years, gives us choices for optimization and inspiration for new functions
Classification Model Performance Metrics
Using the following metrics gives a more accurate picture of model performance
Neural Network Interpretability Visually
Understanding the activation of a network with the help of semantic dictionaries and non-neg matrix factorization to increase network performance.
Increase Validation Accuracy in Cases of High Variance
How can we make sure the representation learned by our model will be applicable to data the model has never seen before. Overfitting can reduce the validatio...
Weight Initialization in Deep Neural Networks
A set of strategies for weight initialization preventing DNNs from having problems like vanishing or exploding gradients
Reducing Bias to Increase Test Set Accuracy
Gradient Class Activation Mapping provides a method that can be used to visually explore possible biases in the CNNs and DNNs
Hyperparameter Tuning for Model Optimization
Knowing what hyperparameters are available for tuning is an important part of quickly and accurate optimization
Visual Explanation of Neural Networks via CAM
Understanding the spatially important features of Deep and Convolutional Neural Networks using Class Activation Mapping
Optimizing Models using Saliency Maps and CMVs
Extracting visual insight from network layers allows us to optimize and investigate our models
Ceiling Analysis to Evaluate Optimization Potential
Focusing on the module with the most potential gives direction on where to optimize the model pipeline
reference
L-layer Neural Network
Quick reference on a generalized network setup based on number of layers
Linear Algebra in Machine Learning
Linear Algebra reference especially useful when vectorizing Machine Learning operations and understanding intuition for algorithms
Numerical Gradient Checking for Backprop
Backprop can be error-prone. Numeric methods for calculating the gradient is computational slow but easy to implement
Classification Model Performance Metrics
Using the following metrics gives a more accurate picture of model performance
Vim Mnemonic Devices
An easier way to remember what each vim command does
Singleton Swiftly
Two design patterns which can be used to implement Singletons in Swift.
Learning Programming Promises via a Story
Learn the basic idea of promises in Javascript by listening to this story. The code examples may be JS but the story is language agnostic
Mongoose v3 Embedded Object without Explicit Subschema Declaration
A quick code example of how to embed a subdocument/collection of objects in a Mongoose model without creating a whole other explicit subdoc reference
Comparing Mongoose Object Ids
Forget about finding a deeply nested id property that you have to call the .toString() method on in order to compare.
product strategy
Crossing the Chasm
Marketing and selling high-tech products to mainstream customers.
Good to Great
Defines the leadership style of the 90’s and what can be learned and used in the 20th century
Product Considerations when Incorporating Machine Learning
As will any software engineering field, it’s important to consider technical tradeoffs so that we can maximize customer value.
The Innovator’s Dilemma
Explore why great companies can do everything right and then still lose their market
The Innovators
Most innovations in the digital age were done collaboratively. This is the story of why their ability to work as a team made them so creative and successful
Backlog Story Creation and Prioritization
Discussing importance in terms of other features vs in terms of an arbitrary scale keeps focus on the criterion used when creating the feature vs the arbitra...
Smarter Faster Better
Focusing on how you think is more important in productivity than what you think
The Lean Startup
Most startup failures are preventable. How to leverage both human creativity and capital more efficiently
Zero to One
A review and summary of one of the foundational startup books.
Javascript
ECMAScript 6 Cheatsheet
Quick little cheatsheet to get you through ES6
Mobile App PDF generation from HTML
Client side generation of PDFs using jsPDF, HTML, DataURIs, and Cordova on iOS8+ and Android in MeteorJS
Bluebird Promises with Mongoose for MongoDB
Quick examples of using bluebird with mongoose in node. I just want to show you a couple common use cases to help you recognize how to use promises.
Faster Deploy with MeteorJS
Quickly deploy MeteorJS to your own provider or services like Digital Ocean.
Transliteration of Promises to Callbacks
Promises seem like an amazing way to take advantage of non-blocking io in a very readable way
Learning Programming Promises via a Story
Learn the basic idea of promises in Javascript by listening to this story. The code examples may be JS but the story is language agnostic
Method Chaining in JS Style Opinion
A more definitive answer to the indent style of chaining multiple methods in Javascript for easier readability.
engineering execution
Classification Model Performance Metrics
Using the following metrics gives a more accurate picture of model performance
Hyperparameter Range of Value
Understanding how to iterate through the values of the hyperparameters when tuning a Machine Learning algorithm can make a difference when it comes quickly t...
Product Engineering Development Values
Listed below are values that are important in leading a successful engineering team when the goal is to create a useful product.
Efficient Development and Delivery by the Engineering Team
Process of developing and delivering backlog stories as a cohesive and efficient engineering team
Product Management Story Creation
Process of how to create a high value prioritized backlog of understandable stories
Multi Valued Single Jasmine Automated Test Suite
An alternative to npm libraries like ‘jasmine-where’ and full blown data provider pattern. Anything that gives us a boost for our TDD & CI/CD pipeline is...
databases
MongoDB SSH access on remote Meteor deployment
Access the MongoDB instance on your MUP (Meteor UP) deployment using a GUI explorer
Bluebird Promises with Mongoose for MongoDB
Quick examples of using bluebird with mongoose in node. I just want to show you a couple common use cases to help you recognize how to use promises.
Use ‘type’ as a Property Name in a Mongoose Doc
The syntax is a little different since ‘type’ already has a meaning in a Mongoose schema.
Mongoose v3 Embedded Object without Explicit Subschema Declaration
A quick code example of how to embed a subdocument/collection of objects in a Mongoose model without creating a whole other explicit subdoc reference
Comparing Mongoose Object Ids
Forget about finding a deeply nested id property that you have to call the .toString() method on in order to compare.
iOS
Mobile App PDF generation from HTML
Client side generation of PDFs using jsPDF, HTML, DataURIs, and Cordova on iOS8+ and Android in MeteorJS
Dealing with Complex @IBDesignable
When your @IBDesignable is either too complex or requires data not available when previewing in the interface builder, here is how you deal with those errors.
MPAndroidChart to ios-charts syntax conversion
It turns out that there is enough difference in the properties each framework uses that it can be frustrating to learn how to use the ios-charts library. Her...
Singleton Swiftly
Two design patterns which can be used to implement Singletons in Swift.
SMS Implementation Examples in iOS8
How various iOS apps implement SMS/Text based sharing. We consider the pros and cons of each.
math
L-layer Neural Network
Quick reference on a generalized network setup based on number of layers
Linear Algebra in Machine Learning
Linear Algebra reference especially useful when vectorizing Machine Learning operations and understanding intuition for algorithms
Numerical Gradient Checking for Backprop
Backprop can be error-prone. Numeric methods for calculating the gradient is computational slow but easy to implement
Activation Functions for CNNs, RNNs, DNNs
Knowing which activation functions are available, and how it’s changed over the years, gives us choices for optimization and inspiration for new functions
Hyperparameter Tuning for Model Optimization
Knowing what hyperparameters are available for tuning is an important part of quickly and accurate optimization
Node.js
SwaggerJS via Swagger-Tools for NodeJS
Learning by examples
Transliteration of Promises to Callbacks
Promises seem like an amazing way to take advantage of non-blocking io in a very readable way
Node.js Alternate Config File
An alternate config file in node for setting variables based on current env without the overhead of another library with more flexibility than a .json file.
Continuous Integration with Code Coverage in Node.js
Continuous integration and test-driven development are important strategies for any engineering team that wants to be efficient.
product development
SMS Implementation Examples in iOS8
How various iOS apps implement SMS/Text based sharing. We consider the pros and cons of each.
Helping Dyslexics ‘Unscramble’ Websites
Building a Chrome extension that changes more than just the font of a webpage allowing dyslexic users to have a better experience regardless of page design.
Uber-bad Routing Bug
Awful routing makes me wonder if I am being gouged by Uber in cities I am not familiar with.
Reframing a Lyft Bug as Product Feature
Discussing a bug as a feature in the Lyft app that potentially gets users rides at a lower ‘prime time’ multiplier.
DevOps
SwaggerJS via Swagger-Tools for NodeJS
Learning by examples
MongoDB SSH access on remote Meteor deployment
Access the MongoDB instance on your MUP (Meteor UP) deployment using a GUI explorer
Dokku ipaddress:port based access without VHOST
A common use case is to use Dokku without an actual domain. I address how to use a consistent external port with an ip address since the docs don’t.
Faster Deploy with MeteorJS
Quickly deploy MeteorJS to your own provider or services like Digital Ocean.
Swift
MPAndroidChart to ios-charts syntax conversion
It turns out that there is enough difference in the properties each framework uses that it can be frustrating to learn how to use the ios-charts library. Her...
Singleton Swiftly
Two design patterns which can be used to implement Singletons in Swift.
Custom NSNumberFormatter
How to create and class a 100% customized NSNumberFormatter in Swift. Useful when frameworks (cough ‘ios-charts’) require a NSNumberFormatter for value forma...
Faster Logical UIScrollView in Swift
UIScrollView is something that can be very confusing because it uses constraints in a way that they aren’t normally used. Because of this there is so much co...
engineering strategy
Pragmatic Programmer
As an engineering team leader, this book gives great advice. Some of it is outdated, but much of the relevant topics are included below
Engineering Team Principles
The rules that should govern the actions of an engineering team
Ceiling Analysis to Evaluate Optimization Potential
Focusing on the module with the most potential gives direction on where to optimize the model pipeline
The Five Dysfunctions of a Team
A quick book review from the perspective of the management of a engineering team.
neural networks
L-layer Neural Network
Quick reference on a generalized network setup based on number of layers
Neural Network Interpretability Visually
Understanding the activation of a network with the help of semantic dictionaries and non-neg matrix factorization to increase network performance.
Weight Initialization in Deep Neural Networks
A set of strategies for weight initialization preventing DNNs from having problems like vanishing or exploding gradients
Visual Explanation of Neural Networks via CAM
Understanding the spatially important features of Deep and Convolutional Neural Networks using Class Activation Mapping
opinion
Do Biomedical Engineers have an Advantage in Machine Learning?
Biomedical engineers go through a multidisciplinary training that might make them a good major to transition into machine learning and Artificial Intelligence
Reframing a Lyft Bug as Product Feature
Discussing a bug as a feature in the Lyft app that potentially gets users rides at a lower ‘prime time’ multiplier.
Method Chaining in JS Style Opinion
A more definitive answer to the indent style of chaining multiple methods in Javascript for easier readability.
Mongoose.js
Bluebird Promises with Mongoose for MongoDB
Quick examples of using bluebird with mongoose in node. I just want to show you a couple common use cases to help you recognize how to use promises.
Transliteration of Promises to Callbacks
Promises seem like an amazing way to take advantage of non-blocking io in a very readable way
Comparing Mongoose Object Ids
Forget about finding a deeply nested id property that you have to call the .toString() method on in order to compare.
Meteor.js
MongoDB SSH access on remote Meteor deployment
Access the MongoDB instance on your MUP (Meteor UP) deployment using a GUI explorer
Mobile App PDF generation from HTML
Client side generation of PDFs using jsPDF, HTML, DataURIs, and Cordova on iOS8+ and Android in MeteorJS
Faster Deploy with MeteorJS
Quickly deploy MeteorJS to your own provider or services like Digital Ocean.
CI/CD
Multi Valued Single Jasmine Automated Test Suite
An alternative to npm libraries like ‘jasmine-where’ and full blown data provider pattern. Anything that gives us a boost for our TDD & CI/CD pipeline is...
Continuous Integration with Code Coverage in Node.js
Continuous integration and test-driven development are important strategies for any engineering team that wants to be efficient.
TDD
Multi Valued Single Jasmine Automated Test Suite
An alternative to npm libraries like ‘jasmine-where’ and full blown data provider pattern. Anything that gives us a boost for our TDD & CI/CD pipeline is...
Continuous Integration with Code Coverage in Node.js
Continuous integration and test-driven development are important strategies for any engineering team that wants to be efficient.
Mongoose
Use ‘type’ as a Property Name in a Mongoose Doc
The syntax is a little different since ‘type’ already has a meaning in a Mongoose schema.
Mongoose v3 Embedded Object without Explicit Subschema Declaration
A quick code example of how to embed a subdocument/collection of objects in a Mongoose model without creating a whole other explicit subdoc reference
Reference
ECMAScript 6 Cheatsheet
Quick little cheatsheet to get you through ES6
Use ‘type’ as a Property Name in a Mongoose Doc
The syntax is a little different since ‘type’ already has a meaning in a Mongoose schema.
vim
Vim Mnemonic Devices
An easier way to remember what each vim command does
Subvert with Vim Across Multiple files
f you aren’t with it the following with work with built in vim :substitute
Swagger.js
SwaggerJS via Swagger-Tools for NodeJS
Learning by examples
Swagger 2.0 Spec File Upload Method
A little information on how to edit your swagger.json document (v2) so that you can accept file uploads in NodeJS. Includes a workaround for a current bug.
Bluebird.js
Bluebird Promises with Mongoose for MongoDB
Quick examples of using bluebird with mongoose in node. I just want to show you a couple common use cases to help you recognize how to use promises.
Transliteration of Promises to Callbacks
Promises seem like an amazing way to take advantage of non-blocking io in a very readable way
Xcode
Dealing with Complex @IBDesignable
When your @IBDesignable is either too complex or requires data not available when previewing in the interface builder, here is how you deal with those errors.
Attributed Strings in Xcode with Custom Font
Attributed strings build in the storyboard editor which use a custom font does not render correctly. Here are the steps to get around it
Objective-C
Dealing with Complex @IBDesignable
When your @IBDesignable is either too complex or requires data not available when previewing in the interface builder, here is how you deal with those errors.
Attributed Strings in Xcode with Custom Font
Attributed strings build in the storyboard editor which use a custom font does not render correctly. Here are the steps to get around it
Android
Mobile App PDF generation from HTML
Client side generation of PDFs using jsPDF, HTML, DataURIs, and Cordova on iOS8+ and Android in MeteorJS
MPAndroidChart to ios-charts syntax conversion
It turns out that there is enough difference in the properties each framework uses that it can be frustrating to learn how to use the ios-charts library. Her...
MongoDB
MongoDB SSH access on remote Meteor deployment
Access the MongoDB instance on your MUP (Meteor UP) deployment using a GUI explorer
Bluebird Promises with Mongoose for MongoDB
Quick examples of using bluebird with mongoose in node. I just want to show you a couple common use cases to help you recognize how to use promises.
startup strategy
The Lean Startup
Most startup failures are preventable. How to leverage both human creativity and capital more efficiently
Zero to One
A review and summary of one of the foundational startup books.
hyperparameters
Hyperparameter Tuning for Model Optimization
Knowing what hyperparameters are available for tuning is an important part of quickly and accurate optimization
Hyperparameter Range of Value
Understanding how to iterate through the values of the hyperparameters when tuning a Machine Learning algorithm can make a difference when it comes quickly t...
class activation mapping
Reducing Bias to Increase Test Set Accuracy
Gradient Class Activation Mapping provides a method that can be used to visually explore possible biases in the CNNs and DNNs
Visual Explanation of Neural Networks via CAM
Understanding the spatially important features of Deep and Convolutional Neural Networks using Class Activation Mapping
Lyft
Reframing a Lyft Bug as Product Feature
Discussing a bug as a feature in the Lyft app that potentially gets users rides at a lower ‘prime time’ multiplier.
Chrome extension
Helping Dyslexics ‘Unscramble’ Websites
Building a Chrome extension that changes more than just the font of a webpage allowing dyslexic users to have a better experience regardless of page design.
SMS
SMS Implementation Examples in iOS8
How various iOS apps implement SMS/Text based sharing. We consider the pros and cons of each.
When.js
Learning Programming Promises via a Story
Learn the basic idea of promises in Javascript by listening to this story. The code examples may be JS but the story is language agnostic
Docker
Dokku ipaddress:port based access without VHOST
A common use case is to use Dokku without an actual domain. I address how to use a consistent external port with an ip address since the docs don’t.
Nginx
Dokku ipaddress:port based access without VHOST
A common use case is to use Dokku without an actual domain. I address how to use a consistent external port with an ip address since the docs don’t.
Java
MPAndroidChart to ios-charts syntax conversion
It turns out that there is enough difference in the properties each framework uses that it can be frustrating to learn how to use the ios-charts library. Her...
jsPDF
Mobile App PDF generation from HTML
Client side generation of PDFs using jsPDF, HTML, DataURIs, and Cordova on iOS8+ and Android in MeteorJS
ECMAScript 6
ECMAScript 6 Cheatsheet
Quick little cheatsheet to get you through ES6
human behaviour
Thinking, Fast and Slow
An explanation of the two systems that drive the mind
ceiling analysis
Ceiling Analysis to Evaluate Optimization Potential
Focusing on the module with the most potential gives direction on where to optimize the model pipeline
biomedical engineering
Do Biomedical Engineers have an Advantage in Machine Learning?
Biomedical engineers go through a multidisciplinary training that might make them a good major to transition into machine learning and Artificial Intelligence
algorithm options
Choosing an Appropriate ML Algorithm for a Product
Picking the right ML algorithm requires careful consideration of the user, product, team, and business
Tensorflow
ImageDataNet: Generator for Training and Validation
Good organization is key when it comes to the performance of our engineering team. When it comes to training and validation of an ML algorithm, there are som...
Keras
ImageDataNet: Generator for Training and Validation
Good organization is key when it comes to the performance of our engineering team. When it comes to training and validation of an ML algorithm, there are som...
ImageNet
ImageDataNet: Generator for Training and Validation
Good organization is key when it comes to the performance of our engineering team. When it comes to training and validation of an ML algorithm, there are som...
saliency maps
Optimizing Models using Saliency Maps and CMVs
Extracting visual insight from network layers allows us to optimize and investigate our models
class model visualization
Optimizing Models using Saliency Maps and CMVs
Extracting visual insight from network layers allows us to optimize and investigate our models
neural network
Reducing Bias to Increase Test Set Accuracy
Gradient Class Activation Mapping provides a method that can be used to visually explore possible biases in the CNNs and DNNs
DNNs
Weight Initialization in Deep Neural Networks
A set of strategies for weight initialization preventing DNNs from having problems like vanishing or exploding gradients
overfitting
Increase Validation Accuracy in Cases of High Variance
How can we make sure the representation learned by our model will be applicable to data the model has never seen before. Overfitting can reduce the validatio...
semantic dictionary
Neural Network Interpretability Visually
Understanding the activation of a network with the help of semantic dictionaries and non-neg matrix factorization to increase network performance.
dog
Puppy Socialization Sounds
Playlist of sounds to help socialize your puppy