- JAVA, need setting environment variables path.
JAVA_HOME/CLASSPATH/PATH
- HADOOP, need setting environment variables path. Decompress the file as an administrator. Otherwise, a decompression error may occur
HADOOP_HOME/PATH
winutils!!!!IMPORTANT!!! hadoop.dll and winutils.exe
- SPARK, need setting environment variables path.
tips_1: After putting hadoop.dll and winutils in hadoop/bin folder and adding the folder of hadoop to PATH, we also need to put hadoop.dll into the C:\Windows\System32 folder
tips_2: All of the above tools require version mappingsā¦likeā¦spark-3.5.0-bin-hadoop3-scala2.13