As India is the widest market for IT industry various IT company like TCS Wipro Accenture and many more is the very affordable labour force for the IT industry in the India but as of now the current situation of the US and other Western and European country they say and they are facing some recessions but there is no any much more impacted on the Indian MNC specially in the it because here to costing of the employee is not too much as compare to the other country so he there is no much worry about the decisions
How to Import PySpark Pandas? import pyspark.pandas as ps # Import pandas import pandas as pd How to Create pandas DataFrame?? technologies = ({ 'Courses':["Spark","PySpark","Hadoop","Python","Pandas","Hadoop","Spark","Python","NA"], 'Fee' :[22000,25000,23000,24000,26000,25000,25000,22000,1500], 'Duration':['30days','50days','55days','40days','60days','35days','30days','50days','40days'], 'Discount':[1000,2300,1000,1200,2500,None,1400,1600,0] }) df = pd.DataFrame(technologies) print(df) Run Pandas API DataFrame on PySpark (Spark with Python) Use the above created pandas DataFrame and run it on PySpark. In order to do so, you need to use import pyspark.pandas as ps instead of import pandas as pd . And use ps.DataFrame() to create a DataFrame. # Import pyspark.p...
Comments
Post a Comment