Dead link to Simple Attention Network explainer (404)
The link to the simple_attention_network.md (what im assuming is some sort of an explainer) is dead and returns 404.
There is another link at the bottom of the HF card page to a GitHub markdown file about simple attention networks. Try https://github.com/cactus-compute/needle/blob/main/docs/simple_attention_networks.md - I suspect this is where the authors wanted the link to go?
Both huggingface and github links are dead. Please publish it, I'd really love to learn how did you achieve your goals.
Hmmm. The link was active when I wrote my reply.
To be clear, I am not one of the authors, was just passing through looking a this model when it was uploaded and tried to help.
There is still some information about the Simple Attention Network in the main README in their GitHub Repo -https://github.com/cactus-compute/needle/blob/main/README.md . Also, have a look at the source code in the /needle/model folder while you are at the repo - probably has some useful nuggets.
There is an arxiv paper associated with the model: arXiv:2607.18363v1 https://arxiv.org/pdf/2607.18363
There is a bit of information on their company website https://cactuscompute.com/needle
And if you need more information, I'd suggest trying to reach out to them directly (there is an email link at the bottom of their GitHub README).
Hope that helps.
