Neural Network: Logistic RegressionIn this post, I'll deal with logic regression and its implementation of a single neuron network. I hope you have read my previous post on mattresses and its operation using NumPy package. You can click here to go to my previous post Logistic regression basically computes the probability of the output to beContinue reading "Neural Network: Part 2"
Neural Network: Part 1
Basics of NeuronsHey everyone, long time no see. I have been working on some stuff so was busy and away from my blog. Well, as for my interest in AI, I have been working on neural networks and its implementation which I'll discuss in this post.In this post, you will learn:The basic concepts used inContinue reading "Neural Network: Part 1"
SARSA Learning with Python
Hola,I worked on SARSA algorithm as well as on Q Learning algorithm and both of them had different Q matrix (Duh!) The methodology of both of the algorithms depicts how well one algorithm responds to future awards (which we can say OFF Policy for Q learning) while the other works of the current policy andContinue reading "SARSA Learning with Python"
Q-Learning with Python
Hola,Currently, I am working on learning algorithms in Data Science for robotics. Reading many examples online and trying them on my own gives me a feeling of reward. I got deeply fascinated by Q learning algorithm based on the Bellmans equation. I also made a Pong game using Q learning. You can view that project on myContinue reading "Q-Learning with Python"
I2C Verilog Code Explanation II
In my previous post, I explained working of I2C Verilog code. Same is continued here.https://gist.github.com/Shashi18/f8b60a492c1de87b3a34d26ae7b13ece.js else if(left_bits == 10)begin if(sda == 0)begin left_bits <= 1; direction <= 1; temp <= temp_reserved; end else begin direction <= 1; alpha <= 0; left_bits <= left_bits + 1; endendWhen the ACK/NACK is received at 9 then atContinue reading "I2C Verilog Code Explanation II"
I2C Verilog Code Explanation I
In this post, I am going to explain my previous post regarding I2C. You can visit the post by clicking here.https://gist.github.com/Shashi18/f8b60a492c1de87b3a34d26ae7b13ece.js INOUT SDA: The SDA line is the inout port because Master will send data, address along this line as well as the Slave will send ACK/ NACK along the same SDA line hence it has toContinue reading "I2C Verilog Code Explanation I"
ESP8266 WebSockets
I worked on web sockets on a Wemos D1 mini using an ESP8266 chip and it worked fabulously. I have designed an "HTML" file which can initiate a connection with my D1 mini to control the onboard LED.Any board with ESP will work here. In my application, I can switch on and switch off theContinue reading "ESP8266 WebSockets"
I2C Verilog Code and working
I had already made a post regarding I2C long ago, however, in this post I am reposting I2C but with various changes. Some changes involve the using of Acknowledgement Bit by the Slave and Master, Same SDA line for slave address, register address as well as data. No extra data line is required to readContinue reading "I2C Verilog Code and working"
Self Balancing Bot with PID
In my previous project, I dealt with self-balancing robot without PID controller in this version of embedded the PID control on the same boat and the results are a better than the previous version obviously I am using the control systems part where our main objective is to achieve a critically damped robot. It shouldContinue reading "Self Balancing Bot with PID"
Self-Balancing Bot without PID
Self Balancing robot is one awesome form of the subject Control Systems. It relies on the topic "Feedback Controller".It always feels awesome to work on these projects and to calibrate your bot according to your needs. Although calibration my bot took less time than to work with PIDs which can take ages and ages also. Auto-TuneContinue reading "Self-Balancing Bot without PID"