<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	
	>
<channel>
	<title>
	Comments on: How to Install and Setup Apache Spark on Ubuntu/Debian	</title>
	<atom:link href="https://www.tecmint.com/install-apache-spark-on-ubuntu/feed/" rel="self" type="application/rss+xml" />
	<link>https://www.tecmint.com/install-apache-spark-on-ubuntu/</link>
	<description>Tecmint - Linux Howtos, Tutorials, Guides, News, Tips and Tricks.</description>
	<lastBuildDate>Thu, 15 Jul 2021 05:11:03 +0000</lastBuildDate>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	
	<item>
		<title>
		By: Anil		</title>
		<link>https://www.tecmint.com/install-apache-spark-on-ubuntu/comment-page-1/#comment-1547591</link>

		<dc:creator><![CDATA[Anil]]></dc:creator>
		<pubDate>Thu, 15 Jul 2021 05:11:03 +0000</pubDate>
		<guid isPermaLink="false">https://www.tecmint.com/?p=42417#comment-1547591</guid>

					<description><![CDATA[The installation is successful but seeing below issue, I can see HDFS file:
&lt;pre&gt;
scala&#062; &quot;hadoop fs -ls /&quot;!
&lt;/pre&gt;
warning: there was one feature warning; re-run with -feature for details
Found 4 items
drwxr-xr-x   - hadoop supergroup          0 2021-07-14 10:51 /anil
drwxrwxrwx   - hadoop supergroup          0 2021-07-13 23:19 /data
drwxrwxr-x   - hadoop supergroup          0 2021-07-13 00:57 /tmp
drwxr-xr-x   - hadoop supergroup          0 2021-07-13 00:09 /user
res2: Int = 0

while reading from hdfs in spark
&lt;pre&gt;
scala&#062; spark.read.csv(&quot;/data/orders/&quot;).show(10)
org.apache.spark.sql.AnalysisException: Path does not exist: file:/data/orders;
  at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$org$apache$spark$sql
$execution$datasources$DataSource$$checkAndGlobPathIfNecessary$1.apply(DataSource.scala:576)
  at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$org$apache$spark$sql
$execution$datasources$DataSource$$checkAndGlobPathIfNecessary$1.apply(DataSource.scala:559)
  at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
  at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
  at scala.collection.immutable.List.foreach(List.scala:392)
  at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)
  at scala.collection.immutable.List.flatMap(List.scala:355)
  at org.apache.spark.sql.execution.datasources.DataSource.org$apache$spark$sql$execution
$datasources$DataSource$$checkAndGlobPathIfNecessary(DataSource.scala:559)
  at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:373)
  at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:242)
  at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:230)
  at org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:641)
  at org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:487)
  ... 49 elided
&lt;/pre&gt;]]></description>
			<content:encoded><![CDATA[<p>The installation is successful but seeing below issue, I can see HDFS file:</p>
<pre>
scala&gt; "hadoop fs -ls /"!
</pre>
<p>warning: there was one feature warning; re-run with -feature for details<br />
Found 4 items<br />
drwxr-xr-x   &#8211; hadoop supergroup          0 2021-07-14 10:51 /anil<br />
drwxrwxrwx   &#8211; hadoop supergroup          0 2021-07-13 23:19 /data<br />
drwxrwxr-x   &#8211; hadoop supergroup          0 2021-07-13 00:57 /tmp<br />
drwxr-xr-x   &#8211; hadoop supergroup          0 2021-07-13 00:09 /user<br />
res2: Int = 0</p>
<p>while reading from hdfs in spark</p>
<pre>
scala&gt; spark.read.csv("/data/orders/").show(10)
org.apache.spark.sql.AnalysisException: Path does not exist: file:/data/orders;
  at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$org$apache$spark$sql
$execution$datasources$DataSource$$checkAndGlobPathIfNecessary$1.apply(DataSource.scala:576)
  at org.apache.spark.sql.execution.datasources.DataSource$$anonfun$org$apache$spark$sql
$execution$datasources$DataSource$$checkAndGlobPathIfNecessary$1.apply(DataSource.scala:559)
  at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
  at scala.collection.TraversableLike$$anonfun$flatMap$1.apply(TraversableLike.scala:241)
  at scala.collection.immutable.List.foreach(List.scala:392)
  at scala.collection.TraversableLike$class.flatMap(TraversableLike.scala:241)
  at scala.collection.immutable.List.flatMap(List.scala:355)
  at org.apache.spark.sql.execution.datasources.DataSource.org$apache$spark$sql$execution
$datasources$DataSource$$checkAndGlobPathIfNecessary(DataSource.scala:559)
  at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:373)
  at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:242)
  at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:230)
  at org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:641)
  at org.apache.spark.sql.DataFrameReader.csv(DataFrameReader.scala:487)
  ... 49 elided
</pre>
]]></content:encoded>
		
			</item>
	</channel>
</rss>
