Force utc convertion in backend pandas to_datetime function

[schafsam]

Allow mixed timezone and shift them to utc while converting to datetime fixes #1309. The _to_datetime function seems to check for the timezone and adds it afterwards.

Adding the utc=True argument to the to_datetime function works with pandas and modin.pandas.to_datetime. I tried it and for pyspark.pandas but failed already with the import of the engine. Therefore, I assume pyspark might be secondary.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 81.58%. Comparing base (812b2a8) to head (14b5eeb).
Report is 209 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff             @@
##             main    #1955       +/-   ##
===========================================
- Coverage   94.28%   81.58%   -12.70%     
===========================================
  Files          91      121       +30     
  Lines        7013     9396     +2383     
===========================================
+ Hits         6612     7666     +1054     
- Misses        401     1730     +1329     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[cosmicBboy]

Hi @schafsam, looks like the tests/core/test_pandas_engine.py::test_pandas_datetimetz_dtype is failing.

Adding the utc=True argument to the to_datetime function works with pandas and modin.pandas.to_datetime

Can't this be addressed by adding utc=True to the to_datetime_kwargs dict option?

[schafsam]

Hi @cosmicBboy

That was the second thought to handle it with to_datetime_kwargs. I will give it a try, but need to figure out how or where it is set.

[cosmicBboy]

I will give it a try, but need to figure out how or where it is set.

If you provide a code snippet I can help out