Lemmy.🐟
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
ikidd@lemmy.worldM to Artificial Intelligence@lemmy.worldEnglish · 20 days ago

The Bitter Lesson is coming for Tokenization

lucalp.dev

external-link
message-square
0
link
fedilink
  • cross-posted to:
  • machinelearning@lemmy.ml
6
external-link

The Bitter Lesson is coming for Tokenization

lucalp.dev

ikidd@lemmy.worldM to Artificial Intelligence@lemmy.worldEnglish · 20 days ago
message-square
0
link
fedilink
  • cross-posted to:
  • machinelearning@lemmy.ml
Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.
alert-triangle
You must log in or register to comment.

Artificial Intelligence@lemmy.world

ai_@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !ai_@lemmy.world

Welcome to the AI Community!

Let’s explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

  • Be kind and respectful.
  • Share high-quality contributions.
  • Stay on-topic.
  • Enhance accessibility.
  • Verify information.
  • Encourage meaningful discussions.

You can access the AI Wiki at the following link: AI Wiki

Let’s create a thriving AI community together!

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 26 users / day
  • 91 users / week
  • 183 users / month
  • 1.03K users / 6 months
  • 1 local subscriber
  • 1.69K subscribers
  • 241 Posts
  • 264 Comments
  • Modlog
  • mods:
  • ikidd@lemmy.world
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org