Inspectopedia Help

Unresolved columns

Reports attempts to access PySpark DataFrame columns that do not exist in the schema.

Example:

df = spark.createDataFrame(data=[(“John”, 10), (“Anakin”, 20), (“Luke”, 30)], schema=[“name”, “age”]) df.select(“unknown_column”)

Inspection Details

By default bundled with:

IntelliJ IDEA 2024.1, Qodana for JVM 2024.1,

Can be installed with plugin:

Spark, 241.16690

Last modified: 29 April 2024