- Build Logical Network consists of: + Multi-nomial(x ; h_k). + h_k: output of BiLSTM (model dependencies between different layers). + The representations operates the finite recursion to feed through the logical gate multiple times. - Training (Optimization Stage): + Optimize encoder, fix logical network: + Optimize logical network, fix encoder: