• Mixture of Experts

   · 07 Sep 2025

  I first time read this paper where Mixture of Experts was used for LLMs in multimodality. And chatgpt gave me the definition of mixture of experts with multimodality as a gatekeeper which decides what modality to choose for the final decision. Like if the audio and video modalities are present then the gatekeeper decides what will decide the final decision...

• Important Things Other Than Will Power To Do Phd

   · 28 Aug 2025

  One thing that I am learning and in the last two years that I have learnt is embrace failure. What you fail, you constantly analyse what happened, who was at fault. If you have high self esteem you blame the system. If you have low self esteem like me, you will blame yourself. But above both its about accepting what...