EvalAI
@eval_ai
Followers
1K
Following
291
Media
10
Statuses
193
Evaluating state-of-the-art in AI
Atlanta, GA
Joined September 2013
Submissions now open on EvalAI for #AlexaPrize SimBot Challenge from @AmazonScience π Prizes worth $500K, $100K, and $50K for winners!
Today, the #AlexaPrize SimBot Public Benchmark Challenge starts! It's the first time Amazon has welcomed teams other than those sponsored by the company to take part in the challenge. Visit the @eval_ai website for more information, and how to participate: https://t.co/QpZ8wemHqG
1
7
15
Excited to share a look-back on the Ego4D challenges 2022! In spite of being a brand new dataset, we had strong uptake and healthy competition, leading to significant gains over our baselines (upto 300%!). Check out our analysis and join us in 2023 :)
2
13
51
New milestone: EvalAI now hosts 100+ active challenges! From 1 challenge (VQA) in 2017 to here in 5 years: - 200+ challenges - 18k+ users - 180k+ submissions - 30+ organizations
0
1
19
New year, new user @AmazonScience and new challenge on @eval_ai π. Can't be a better start for 2022!
The #AlexaPrize SimBot Challenge is a competition to advance the development of next-gen virtual assistants that will help humans complete real-world tasks. Learn more about the public benchmark phase on @eval_ai, which starts Jan 10, and ends April 30: https://t.co/QpZ8wemHqG
0
4
12
EvalAI: :cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI Lang: Python βοΈ 1290 #MachineLearning Author: @eval_ai
https://t.co/FAHI14jxhA
github.com
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI - GitHub - Cloud-CV/EvalAI: :cloud: :bar_chart: Evaluating state of the art in AI
0
2
4
We provide datasets in the Neurodata Without Borders @NeurodataWB format, accessible via @DANDIarchive. We host benchmarks and leaderboards on the @eval_ai platform, with private held-out data for standardized model evaluation.
1
5
15
Excited to host BEHAVIOR Challenge 2021. Visit https://t.co/04T4BAPHHu to participate. π
eval.ai
EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.
Drum roll! We release BEHAVIOR, an embodied AI benchmark and challenge of 100 complex household activities that would pose significant difficulties to all of todayβs state-of-the-art algorithms. Hope to see great participation to this challenge @ICCV_2021
0
3
8
We are happy to announce that our #sceneunderstanding challenge for #CVPR21 has been extended until May 31st. Submissions accepted on @eval_ai
https://t.co/tbJjg6G3P8
@QUTRobotics
0
1
4
TextVQA ( https://t.co/wrIrE2lHpL) and TextCaps ( https://t.co/WAMDurpbFy) 2021 Challenges are live now! Deadline: May 14th, 2021 Winners to be announced at #CVPR21 VQA Workshop ( https://t.co/JkyEkbPmsJ). 1/n
visualqa.org
CVPR 2021
1
8
17
It's that time of the year again :) The 2021 VQA Challenge is now live! It closes May 7th. Also note the TextVQA and TextCaps challenges that involve reading and reasoning about text in images.
VQA Challenge 2021 is live! Deadline: May 7. Link: https://t.co/NQDpIoN6bF. Winners to be announced at #CVPR21 VQA Workshop ( https://t.co/fLbZ6mdsuS). Other challenges @ workshop: TextVQA, TextCaps. (1/2)
0
5
28
Itβs been a long journey. Thanks for the support GSOC @GoogleOSS!
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project π
0
1
25
We also have a few positions available for mentors who will help/mentor students during the summer. Please fill this form ( https://t.co/BEXyVjzPdj) if you are interested in mentoring students in the @gsoc program on #EvalAI and we will reach out to you.
docs.google.com
1
2
6
Here are the project ideas ( https://t.co/dwg01ByNJS) for the summer and we are looking forward to student applications. We encourage students to engage with the community through our GitHub ( https://t.co/HlXxIXnPmK) and Gitter ( https://t.co/sxXAhgcD6M) channels.
github.com
Building platforms for reproducible AI research. CloudCV has 30 repositories available. Follow their code on GitHub.
1
3
9
We are happy to announce that @project_cloudcv has been selected as a mentoring organization for @gsoc 2021. This is the 7th consecutive year and we are excited for the summer with #EvalAI project π
π₯ We have an announcement to make! π₯ We are pleased to welcome 202 open source projects as our Google Summer of Code 2021 mentoring organizations, including 31 first-time organizations. Read and see how to get involved β
1
3
13
Leaderboards of Habitat Autonomous Navigation Challenge 2021 are live! Looking forward to your submission on PointNav w/o localization sensors (βπΊπ 5m ππππ‘β, 3m π€ππ π‘β) and ObjectNav (βππππ π πβπππβ) tasks. https://t.co/xDBR5r8C3R
eval.ai
EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.
0
3
11
We've released a centralized evaluation server on @eval_ai to track community-wide progress on discovering electrocatalysts using ML. https://t.co/j4nh8Idids
https://t.co/sdnSwtlhs9 (2/3)
eval.ai
EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.
1
5
16
13 challenges. 6 workshop organizers. 42 challenge organizers. 17 scientific advisors. 21 organizations. 1 workshop: https://t.co/0COJXOrkPZ
#CVPR2021
We're excited to launch the third Habitat Challenge at the Embodied AI workshop with 15 research & academic institutions. The 2021 Habitat Challenge invites AI experts from around the world to teach machines to navigate real-world environments. #CVPR2021
https://t.co/wefO4xXCz0
0
16
89
Robotic Vision Scene Understanding (RVSU) Challenge -
eval.ai
EvalAI is an open-source web platform for organizing and participating in challenges to push the state of the art on AI tasks.
1
0
0