-
Research Stage
·I am done with learning…I am not done. I still think learning new topics is important but I have to focus on something else than learning and ideas. and that is being rigorous on a topic. Read, write and think about a topic rigorously and ask questions. I remember that paper on latent disentanglement by rishabh parihar. It was so...
-
Mixture of Experts
·I first time read this paper where Mixture of Experts was used for LLMs in multimodality. And chatgpt gave me the definition of mixture of experts with multimodality as a gatekeeper which decides what modality to choose for the final decision. Like if the audio and video modalities are present then the gatekeeper decides what will decide the final decision...