20amp breaker 3hp table saw so 9.3 amp draw.
Without knowing specifics of the table saw motor, this is a guessing game.
A single phase, AC motor by Table 430.248 says full load current (FLA) for a 3 HP motor is 17Amps. Depending on the type of breaker you are using, it would be sized to a maximum of (175 - 300%) of the FLA.
Do you care ? Probably not. If the manufacturer said to use a 20A breaker you are good; if you have been using the tool without tripping, well - probably good enough. Since your sub-panel has a 60A feeder and any one tool is doing OK with a 20 Amp breaker, you are on safe ground putting a 40A breaker on your EVSE branch circuit.
A 40A breaker for the EVSE limits you to 32A load -- the maximum your Tesla mobile EVSE with a 14-50 pigtail is going to pull no matter what.
Are those the only two loads your sub-panel will ever have concurrently ? Then a 40A breaker for the EVSE is fine.
If you might add other concurrent loads -- a heat pump to cool the room, e.g., then think about putting in a 30A breaker for a 14-30 receptacle. Then you will have some room for three concurrent loads.
---
As an aside, if the feeder to your sub-panel is #4 AWG Cu in conduit, it is rated for 85A. #6 AWG Cu in conduit is rated for 65A. Feeders can be sized to carry 83% of the calculated load