During Day 1 of the California music festival, which was attended by a slew of celebs, the new couple was spotted showing some PDA while watching a set by the blues and punk duo The Kills, reported E!Online.
Fans posted pics of the two on Twitter and Instagram.
"They came in about 20 minutes in to The Kills set," an eyewitness told E! News exclusively.
"They were hugging and with a group of other people. Orlando was behind her and swaying with her to the music. They also were vaping together. They were kissing and very much a couple."
The two sparked romance rumours in January when were photographed together at a 2016 Golden Globes after party. They have since been spotted looking cozy together many times in Los Angeles, where they live separately, and other cities.