refactor: introduce shared tokenizer abstraction and split implementa… #2199
| Job | Run time |
|---|---|
| 5m 35s | |
| 4m 49s | |
| 9m 40s | |
| 14m 30s | |
| 8m 8s | |
| 17m 18s | |
| 6m 55s | |
| 48m 50s | |
| 32m 21s | |
| 3m 1s | |
| 2m 59s | |
| 7m 0s | |
| 3m 5s | |
| 3m 4s | |
| 1h 57m 54s | |
| 1m 49s | |
| 4h 46m 58s |
| Job | Run time |
|---|---|
| 5m 35s | |
| 4m 49s | |
| 9m 40s | |
| 14m 30s | |
| 8m 8s | |
| 17m 18s | |
| 6m 55s | |
| 48m 50s | |
| 32m 21s | |
| 3m 1s | |
| 2m 59s | |
| 7m 0s | |
| 3m 5s | |
| 3m 4s | |
| 1h 57m 54s | |
| 1m 49s | |
| 4h 46m 58s |