Skip to content
Concise and Practical AI/ML
  • Pages
    • Preface
    • What are AI and ML
    • Mathematics Recap
      • Calculus
      • Algebra
    • Libraries to Use
    • Models for ML
    • Methods of ML
    • Neuralnet Alphabet
    • Neuralnet
      • Neuron
        • Types of Neurons
        • Input Separations
        • Activation Functions
      • Layers in Network
      • Loss Functions
      • Gradient Descent
      • Feedforward
      • Backpropagation
      • Optimisers & Training
      • Techniques in ML
        • Normalisation
        • Regularisation
        • Concatenation
        • Boosted & Combinatory
        • Heuristic Hyperparams
      • Problems in Neuralnet
        • Overfitting
        • Explosion and Vanishing
    • Supervised Learning
      • Regression
      • Classification
    • Reinforcement Learning
      • Concepts
      • Learning Tactics
      • Policy Network
      • Bellman Equation
      • Q-table
      • Q-network
    • Unsupervised Learning
      • Some Applications
    • Incremental Learning
    • Case Studies
      • Algorithm Approximator
      • Regression
      • Classification
      • Sequence Learning
      • Pattern Learning
      • Generative
    • Notable Mentions
A neuron in machine learning is modelled after the multipolar neuron in biology. It has multiple inputs and a single output. Multipolar neurons are the most common neurons in the brain. Multipolar neurons in be found in any brain area with sensory neurons, interneurons, or motor neurons.

Multipolar Neuron

image.png

Terms in Neuron

Weights

Weights are the variables at all dendrites.

Bias

Bias is a special weight for each neuron, possibly imaginable as a weight in soma outside nucleus. It receives no input and thus its input is always constant 1.

Core Processing

Dot-product

Dot-product is used in basic neurons.

LSTM, Convo, and Others

Other types of neurons have different core processing, not dot-product.

Activation

The activation process usually utilises a limiter function called activation function.

 
Want to print your doc?
This is not the way.
Try clicking the ··· in the right corner or using a keyboard shortcut (
CtrlP
) instead.