Links
OneTo3D: GitHub Code Project Page
Example
1. Input Text Code:
The object moves 2 miles in x direction, moves 2 miles in -x direction.
Output Dynamic 3D:
2. Input Text Code:
The object moves 2 miles in x direction, moves 2 miles in -x direction, then moved 3 miles in y direction, moving 1 miles in -z direction, then moved 5 miles in -y direction, moving 1 miles in z direction.
Output Dynamic 3D:
3. Input Text Code:
The object raises his head, then bowed his head, then raises his head, then bowed his head.
Output Dynamic 3D:
4. Input Text Code:
The object raises his head 80 degrees, then bowed his head 30 degrees, then raises his head 10 degrees, then bowed his head 50 degrees.
Output Dynamic 3D:
5. Input Text Code:
The object raises his head 20.12 degrees and shakes his head 60 degrees.
Output Dynamic 3D:
6. Input Text Code:
The object looks left, looks right, looks left 22.33 degrees, looks right 22.33 degrees, raises his head 20.12 degrees and shakes his head 60 degrees.
Output Dynamic 3D:
7. Input Text Code:
Big: The object walked 2 steps times and ran 3 steps times seconds to the car.
Output Dynamic 3D:
8. Input Text Code:
The object walked 10 steps times, raises his head 60 degrees, and ran 10 steps times seconds, bowed his head 80 degrees, then walkes 10 steps.
Output Dynamic 3D:
9. Input Text Code:
The object walked 2 steps times, moves 3 miles in -y direction, and ran 3 steps times seconds, following moves 2 miles in y direction.
Output Dynamic 3D:
10. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, moves 3 miles in -y direction, and ran 3 steps times seconds, following moves 2 miles in y direction. Then turns left, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, following moves 2 miles in y direction.
Output Dynamic 3D:
11. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, moves 3 miles in -y direction, and ran 3 steps times seconds, following moves 2 miles in y direction. Then turns left, moves 3 miles in x direction, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, following moves 2 miles in y direction.
Output Dynamic 3D:
12. Input Text Code:
The object raised his left hand, raises his right hand, puts down his left hand, puts down his right hand, going.
Output Dynamic 3D:
13. Input Text Code:
The object raised his left hand, raises his right hand, puts down his left hand, puts down his right hand, puts down his left hand 88 degrees, puts down his right hand 88 degrees, raising his left hand 118 degrees, raised his right hand 118 degrees, going.
Output Dynamic 3D:
14. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, raised his left hand, moves 3 miles in -y direction, puts down his left hand, and ran 3 steps times seconds, raises his right hand 60 degrees, following moves 2 miles in y direction, puts down his right hand 88 degrees, then turns left, moves 3 miles in x direction, raising his left hand 20 degrees, raised his right hand 20 degrees, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, following moves 2 miles in y direction.
Output Dynamic 3D:
15. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, raised his left hand, raises his right hand 30 degrees, moves 3 miles in -y direction, raises his head 30 degrees, bowed his head 20 degrees, puts down his left hand, puts down his right hand 10 degrees, and ran 3 steps times seconds, following moves 2 miles in y direction, puts down his right hand 88 degrees, then turns left, moves 3 miles in x direction, raising his left hand 20 degrees, raised his right hand 20 degrees, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, puts down his left hand 60 degrees, puts down his right hand 10 degrees, following moves 2 miles in y direction.
Output Dynamic 3D:
16. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, raised his left hand, raises his right hand 30 degrees, moves 3 miles in -y direction, raises his head 30 degrees, bowed his head 20 degrees, puts down his left hand, puts down his right hand 10 degrees, and ran 3 steps times seconds, following moves 2 miles in y direction, puts down his right hand 88 degrees, then turns left, moves 3 miles in x direction, looks left, looks right, raising his left hand 20 degrees, raised his right hand 20 degrees, looks right 22.33 degrees, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, puts down his left hand 60 degrees, puts down his right hand 10 degrees, following moves 2 miles in y direction.
Output Dynamic 3D:
17. Input Text Code:
The object lifts his left leg, puts down his left leg, lifts his right leg, puts down his right leg, going
Output Dynamic 3D:
18. Input Text Code:
The object lifts his left leg, puts down his left leg, lifts his right leg, puts down his right leg, puting down his right leg, putting down his left leg 60 degrees, lifts his left leg 60 degrees, going.
Output Dynamic 3D:
19. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, raised his left hand, raises his right hand 30 degrees, moves 3 miles in -y direction, raises his head 30 degrees, bowed his head 20 degrees, puts down his left hand, puts down his right hand 10 degrees, and ran 3 steps times seconds, following moves 2 miles in y direction, puts down his right hand 88 degrees, puts down his left hand 88 degrees, then turns left, moves 3 miles in x direction, looks left, looks right, raising his left hand 20 degrees, raised his right hand 20 degrees, looks right 22.33 degrees, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, puts down his left hand 60 degrees, puts down his right hand 10 degrees, following moves 2 miles in y direction. Then the object lifts his left leg, puts down his left leg, lifts his right leg, puts down his right leg, puting down his right leg, putting down his left leg 60 degrees, lifts his left leg 60 degrees, going.
Output Dynamic 3D:
20. Input Text Code:
The object raises his left forearm, raises his right forearm, puts down his left forearm, puts down his right forearm going.
Output Dynamic 3D:
21. Input Text Code:
The object raises his left forearm, raises his right forearm, puts down his left forearm, puts down his right forearm going.
Output Dynamic 3D:
22. Input Text Code:
The object puts down his left calf 60 degrees, lifts his left calf 60 degrees, puts down his right calf 60 degrees, lifts his right calf 60 degrees, going.
Output Dynamic 3D:
23. Input Text Code:
The object lifts his left leg 0 degrees,, lifts his left leg, puts down his left calf 60 degrees, lifts his left calf 60 degrees, puts down his right calf 60 degrees, lifts his right calf 60 degrees, puts down his left leg, going.
Output Dynamic 3D:
24. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, raised his left hand, raises his right hand 30 degrees, moves 3 miles in -y direction, raises his head 30 degrees, bowed his head 20 degrees, puts down his left hand, puts down his right hand 10 degrees, and ran 3 steps times seconds, following moves 2 miles in y direction, puts down his right hand 88 degrees, puts down his left hand 88 degrees, then turns left, moves 3 miles in x direction, looks left, looks right, raising his left hand 60 degrees, raised his right hand 20 degrees, looks right 22.33 degrees, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, puts down his left hand 60 degrees, puts down his right hand 10 degrees, following moves 2 miles in y direction. Then the object lifts his left leg, puts down his left leg, lifts his right leg, puts down his right leg, puting down his right leg, putting down his left leg 60 degrees, lifts his left leg 10 degrees. Then The object lifts his left leg 0 degrees, lifts his left leg, puts down his left calf 60 degrees, lifts his left calf 60 degrees, puts down his right calf 60 degrees, lifts his right calf 60 degrees, puts down his left leg, going.
Output Dynamic 3D:
25. Input Text Code:
The object walked 2 steps or times, then turns left 0 degrees, raised his left hand, raises his right hand 30 degrees, moves 3 miles in -y direction, raises his head 30 degrees, bowed his head 20 degrees, puts down his left hand, puts down his right hand 10 degrees, and ran 3 steps times seconds, following moves 2 miles in y direction, puts down his right hand 88 degrees, puts down his left hand 88 degrees, then turns left, moves 3 miles in x direction, looks left, looks right, raising his left hand 60 degrees, raised his right hand 20 degrees, looks right 22.33 degrees, walked 2 steps or times, moves 3 miles in -y direction, and ran 3 steps times seconds, puts down his left hand 60 degrees, puts down his right hand 10 degrees, following moves 2 miles in y direction. Then the object lifts his left leg, puts down his left leg, lifts his right leg, puts down his right leg, puting down his right leg, putting down his left leg 60 degrees, lifts his left leg 10 degrees. Then The object lifts his left leg 0 degrees, lifts his left leg, puts down his left calf 60 degrees, lifts his left calf 60 degrees, puts down his right calf 60 degrees, lifts his right calf 60 degrees, puts down his left leg, moves 3 miles in -x direction, run in 5 miles, raised his left hand 60 degrees, waves his left hand, waves his left forearm, going.
Output Dynamic 3D:
Paper Cite
@misc{lin2024oneto3d,
title={OneTo3D: One Image to Re-editable Dynamic 3D Model and Video Generation},
author={Jinwei Lin},
year={2024},
eprint={2405.06547},
archivePrefix={arXiv},
primaryClass={cs.CV}
}
title={OneTo3D: One Image to Re-editable Dynamic 3D Model and Video Generation},
author={Jinwei Lin},
year={2024},
eprint={2405.06547},
archivePrefix={arXiv},
primaryClass={cs.CV}
}