Extending the Context of Pretrained LLMs by Dropping Their Positional Embedding (https://www.arxiv.org/abs/2512.12167)
AI & ML interests
We are a Tokyo-based R&D company on a quest to create a new kind of foundational AI model based on nature-inspired intelligence.
Recent Activity
Papers
View all Papers
spaces
6
Running
on
Zero
19
Llama 3 Karamaru V1
🐻
Classical Japanese Chatbot
Running
on
Zero
46
Evo-Ukiyoe
🐠
Generate Japanese ukiyo-e style images from prompts
Running
on
Zero
18
Llama-3-EvoVLM-JP-v2
🐠
Chat with images and text using a Japanese visual language model
Running
on
Zero
18
Evo-Nishikie
🐠
Generate detailed ukiyo-e style images from single-color input
Running
on
Zero
53
EvoSDXL JP
🐠
Generate images from Japanese prompts
Running
on
Zero
63
EvoVLM JP
🐠
Ask questions about images to get detailed answers
models
28
SakanaAI/Llama-2-7b-hf-DroPE
7B
•
Updated
•
6
•
1
SakanaAI/RePo-OLMo2-1B-stage2-L5
Text Generation
•
1B
•
Updated
•
218
•
1
SakanaAI/ctm-maze-large
Text Generation
•
Updated
•
28
•
2
SakanaAI/ctm-imagenet
Text Generation
•
Updated
•
188
•
5
SakanaAI/RLT-7B
Text Generation
•
8B
•
Updated
•
20
•
•
18
SakanaAI/RLT-32B
Text Generation
•
33B
•
Updated
•
7
•
6
SakanaAI/Metom
5.64M
•
Updated
•
316
•
6
SakanaAI/text-to-lora
Updated
•
9
SakanaAI/Llama-3-Karamaru-v1
Text Generation
•
8B
•
Updated
•
18
•
•
19
SakanaAI/TAID-VLM-2B
Visual Question Answering
•
2B
•
Updated
•
14
•
5
datasets
16
SakanaAI/Kamon
Viewer
•
Updated
•
10k
•
43
SakanaAI/Sudoku-CTC-Reasoning
Viewer
•
Updated
•
1.81k
•
153
•
10
SakanaAI/Sudoku-Bench
Viewer
•
Updated
•
2.77k
•
1.34k
•
10
SakanaAI/mazes-extralarge
Viewer
•
Updated
•
50k
•
15
SakanaAI/mazes-large
Viewer
•
Updated
•
50k
•
12
SakanaAI/mazes-medium
Viewer
•
Updated
•
60k
•
22
SakanaAI/mazes-small
Viewer
•
Updated
•
10k
•
42
SakanaAI/TransEvalnia
Viewer
•
Updated
•
3.84k
•
23
•
4
SakanaAI/ALE-Bench
Updated
•
6.93k
•
11
SakanaAI/EDINET-Bench
Viewer
•
Updated
•
2.59k
•
278
•
9