Tesla's Fremont factory used to belong to NUMMI, a joint venture between GM and Toyota to produce Toyotas and Toyotas badged as GM vehicles. At that time, for two or three decades starting in the 1980s, the plant had a theoretical maximum capacity of 500,000 vehicles per year, but the maximum it achieved during that period was about 430,000. This is covered in more detail in
this Business Insider article. (The article is from 2017 and is a bit "down" on Tesla, but AFAIK its statements about the plant's NUMMI-era capacity are correct.) Thus, based solely on the old NUMMI capacity, a production of 400,000 to 500,000 per year is entirely plausible. That said, it could be higher or lower than that because building an EV is a bit different than building an ICE vehicle, because Tesla and NUMMI are likely doing things differently (different amounts of components built on- vs. off-site, for instance), and because Tesla has moved some manufacturing into its (in)famous "tent."
Another issue in the question of increasing production with the future introduction of the Model Y is Gigafactory 3. With much Chinese production moved to China, Tesla may be able to cut back on Model 3 production at Fremont, produce as many or more Model 3s worldwide, and produce more cars total worldwide. Tesla's also talking about an assembly line in Europe, which will have similar effects, although probably not by early 2021.