Create
- Ask a question
- Create an article
- Topics
- Questions
- Articles
- Users
- Badges
Sign in

Dataset

Cancel

Cancel

All Posts

Updated
Created
Hottest
Votes
Most viewed

Improve performance of groupByKey for a large dataset

1 Answer

0 Votes

754 Views

published by

Valery Khamenya on Jun 19, '18

dataset·reducebykey·groupbykey

why there is no reduceByKey in dataset?

0 Answers

0 Votes

154 Views

asked by

Sukumaar Mane on May 16, '18

spark·dataset·reducebykey·groupbykey·paired rdd

How to maintain large hive query in Spark

0 Answers

0 Votes

39 Views

published by

michellema on Apr 10, '18

spark sql·spark-sql·dataset

How to maintain large hive query in Spark

0 Answers

0 Votes

39 Views

asked by

michellema on Apr 10, '18

spark sql·spark-sql·dataset

maximum fields allowed in a dataset that comes form Kafka topic

0 Answers

0 Votes

31 Views

asked by

Harindar on Mar 19, '18

dataset·when i try to read a kafka topic that has 500 fields i am not able to write it to console

window function for DataSet

0 Answers

0 Votes

81 Views

asked by

mans4singh on Dec 25, '17

structured streaming·dataset·window functions

what are the alternatives for a Collect_set in Datasets for better performance ?

0 Answers

0 Votes

270 Views

edited by

panos on Dec 4, '17

spark sql·performance·dataset·groupby

CSV data source does support array data type, but not when downloading full results

0 Answers

1 Votes

1.8k Views

commented by

yoderj on Aug 16, '17

csv·dataset·export·download

austin.powell

using DataSet.repartition in Spark 2 - several tasks handle more than one partition

0 Answers

1 Votes

387 Views

asked by

eeldor on Jul 31, '17

spark streaming·dataset·javardd·repartitioning

Pravin Agrawal

In Pyspark how do we differentiate Dataset from DataFrame?

1 Answer

0 Votes

200 Views

answered by

jules on Jul 28, '17

pyspark·dataframe·dataset

How to split/merge records using sparksql/dataframe/dataset

0 Answers

0 Votes

338 Views

asked by

jxoneplus on Jun 26, '17

spark sql·dataframe·sparksql·dataset

Kryo Serialization for Dataset

0 Answers

0 Votes

196 Views

asked by

yasin on Jun 24, '17

dataset·kryo·spark 2.x

The data set size for SVM

0 Answers

0 Votes

103 Views

published by

Bigevilking123 on Jun 22, '17

dataset·sklearn·svm

Read a Sorted File

0 Answers

0 Votes

104 Views

asked by

yasin on Jun 18, '17

csv·dataset·hdfs·repartitioning·sorting

Scala - TimestampType - No Encoder found for org.apache.spark.sql.types.TimestampType

1 Answer

0 Votes

2.1k Views

answered by

royatdatabricks on Jun 16, '17

dataframe·scala·dataset·timestamp

1
2
3
›

50 Posts

32 Users

2 Followers

Topic Experts

bizworld

0Points

Related Topics

spark sql dataframe spark reducebykey repartitioning scala csv groupby encoder datasets spark-sql groupbykey table example dataframes spark streaming notebook word count. spark 1.6.1 javardd spark-1.6 export case class spark 1.60 sorting

Product
- Databricks Cloud
- FAQ
Spark
Services
Company
- About Us
- Team
- News
- Contact
Careers
Blog

Databricks Inc.
160 Spear Street, 13th Floor
San Francisco, CA 94105

info@databricks.com
1-866-330-0121

Twitter
LinkedIn
Facebook
Facebook

© Databricks 2015. All rights reserved. Apache Spark and the Apache Spark Logo are trademarks of the Apache Software Foundation.

Anonymous
Sign in
Create
Ask a question
Create an article
Explore
Topics
Questions
Articles
Users
Badges