Discussions

• 1 You must be logged in to vote

  💡

  can we possibly train (ideally continual pretraining) Gemma 3 series of models on t5x ?

  StephennFernandes started Sep 3, 2025 in Ideas

  

  

  0
• 2 You must be logged in to vote

  🙏

  Z-loss definition

  Jbiloki asked Jul 10, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Instruction fine tuning Flan-T5, non-english language

  holmbuar asked Mar 12, 2023 in Q&A · Unanswered

  

  

  1
• 3 You must be logged in to vote

  🙏

  T5x Model vs T5 which one is better ?

  rajneesh407 asked Sep 20, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Pretrain T5 from a checkpoint

  thanhnx12 asked Sep 6, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Proper installation and use

  vgaraujov asked Aug 20, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is it possible to get top N predictions, with scores?

  jkhartshorne asked May 30, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  extracting a sub-model from a trained transfromer model

  agoliaei started May 2, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  GSPMD "2D Partitioning" Training Speed

  agemagician asked Apr 5, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  t5x in Colab

  agoliaei asked Dec 19, 2022 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Using t5_1_1 xxl on TPU Pod v3-32

  md975 asked Jan 1, 2023 in Q&A · Unanswered

  

  

  0
• 0 You must be logged in to vote

  🙏

  How to use a custom dataset?

  akku779 asked Oct 17, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  None values not supported error when using seqio mixture

  StephennFernandes started Sep 15, 2022 in General

  

  

  7
• 1 You must be logged in to vote

  💬

  how do i too add the extra_ids already for the tokenizer such that i could keep the extra_ids=0

  StephennFernandes started Aug 30, 2022 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to force T5x code not to use/save any checkpoint using just gin configs

  sudhakarsingh27 asked Jun 3, 2022 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  Evaluation accuracy

  peregilk asked May 5, 2022 in Q&A · Unanswered

  

  

  4
• 3 You must be logged in to vote

  🙏

  SentencePiece model training

  versae asked Apr 21, 2022 in Q&A · Answered

  

  

  4