I've been taking it a bit easier after the release of 3.0.x, thinking about good next steps to work on. But I wanted to write a quick post to keep you in the loop for things I'm thinking about:
- Load Performance - I'm always keeping an eye out for performance improvements; in particular, loading takes so long. This is due to Tensorflow.js model load times, as the first time it does an image prediction it has to do a bunch of extra work. But the team has been hard at work on this and I'm evaluating some work they've already done.
- Better Video Support - I've gotten some exit survey feedback that they wished videos/animations were better supported. Well, so do I. I'd like to see if I can think up some ways to support certain DASH and HLS videos a bit better; I have some ideas but we'll see. I think a good next target might be Reddit support.
- Model Architecture - AI (or more accurately, machine learning) is a booming field right now, with many strong advancements occurring fairly regularly. Vision Transformers (ViT) as well as certain Unsupervised/Semi-Supervised Learning techniques have been making strides recently, so I'm keeping my eyes open for possibilities there. In particular, I'm intrigued by the hybrid CNN/ViT approach taken by Compact Convolutional Transformers (CCT).
I'd also like to take a moment and thank the Tensorflow.js, Firefox, and mux.js teams for helping make the software that makes this possible!
