0

We are trying to save a DataFrame in SQL Server (V2005) using the following method:

df_cards.write.jdbc(url=conn_str, table=tablename, mode='append', properties=properties)

However, we encountered the following error:

org.apache.spark.SparkSQLException: Unrecognized SQL type -151

The most puzzling part is that the data has been saved in the database.

Somebody can help us?

Thank you in advance for your help.

Improve this question
3
  • You are using a version of SQL Server that is so long out of support it's no surprise it behaves unexpectedly
    – Dale K
    Commented Jul 26, 2023 at 7:12
  • It sometimes chokes like this in getCatalystType() when selecting back the data back from the target table. Do you have a column with a user-defined type in the target table?
    – AlwaysLearning
    Commented Jul 26, 2023 at 7:38
  • Hi AlwaysLearning. We have the problem with two columns of type datetime in SQL, dont have a user-defined type in the target table . We suspect that because when we do a select we must cast those columns. Any idea to solve it?
    – Moisés
    Commented Jul 26, 2023 at 7:47
Related questions
3282
How to add a column with a default value to an existing table in SQL Server?
1438
Check if table exists in SQL Server
2182
How to check if a column exists in a SQL Server table
Load 7 more related questions Show fewer related questions

0

Reset to default