pandas.
DataFrame
Two-dimensional, size-mutable, potentially heterogeneous tabular data.
Data structure also contains labeled axes (rows and columns). Arithmetic operations align on both row and column labels. Can be thought of as a dict-like container for Series objects. The primary pandas data structure.
Dict can contain Series, arrays, constants, or list-like objects.
Changed in version 0.23.0: If data is a dict, column order follows insertion-order for Python 3.6 and later.
Changed in version 0.25.0: If data is a list of dicts, column order follows insertion-order for Python 3.6 and later.
Index to use for resulting frame. Will default to RangeIndex if no indexing information part of input data and no index provided.
Column labels to use for resulting frame. Will default to RangeIndex (0, 1, 2, …, n) if no column labels are provided.
Data type to force. Only a single dtype is allowed. If None, infer.
Copy data from inputs. Only affects DataFrame / 2d ndarray input.
See also
DataFrame.from_records
Constructor from tuples, also record arrays.
DataFrame.from_dict
From dicts of Series, arrays, or dicts.
read_csv
read_table
read_clipboard
Examples
Constructing DataFrame from a dictionary.
>>> d = {'col1': [1, 2], 'col2': [3, 4]} >>> df = pd.DataFrame(data=d) >>> df col1 col2 0 1 3 1 2 4
Notice that the inferred dtype is int64.
>>> df.dtypes col1 int64 col2 int64 dtype: object
To enforce a single dtype:
>>> df = pd.DataFrame(data=d, dtype=np.int8) >>> df.dtypes col1 int8 col2 int8 dtype: object
Constructing DataFrame from numpy ndarray:
>>> df2 = pd.DataFrame(np.array([[1, 2, 3], [4, 5, 6], [7, 8, 9]]), ... columns=['a', 'b', 'c']) >>> df2 a b c 0 1 2 3 1 4 5 6 2 7 8 9
Attributes
T
Transpose index and columns.
at
Access a single value for a row/column label pair.
attrs
Dictionary of global attributes on this object.
axes
Return a list representing the axes of the DataFrame.
columns
The column labels of the DataFrame.
dtypes
Return the dtypes in the DataFrame.
empty
Indicator whether DataFrame is empty.
iat
Access a single value for a row/column pair by integer position.
iloc
Purely integer-location based indexing for selection by position.
index
The index (row labels) of the DataFrame.
loc
Access a group of rows and columns by label(s) or a boolean array.
ndim
Return an int representing the number of axes / array dimensions.
shape
Return a tuple representing the dimensionality of the DataFrame.
size
Return an int representing the number of elements in this object.
style
Returns a Styler object.
values
Return a Numpy representation of the DataFrame.
Methods
abs(self)
abs
Return a Series/DataFrame with absolute numeric value of each element.
add(self, other[, axis, level, fill_value])
add
Get Addition of dataframe and other, element-wise (binary operator add).
add_prefix(self, prefix)
add_prefix
Prefix labels with string prefix.
add_suffix(self, suffix)
add_suffix
Suffix labels with string suffix.
agg(self, func[, axis])
agg
Aggregate using one or more operations over the specified axis.
aggregate(self, func[, axis])
aggregate
align(self, other[, join, axis, level, …])
align
Align two objects on their axes with the specified join method.
all(self[, axis, bool_only, skipna, level])
all
Return whether all elements are True, potentially over an axis.
any(self[, axis, bool_only, skipna, level])
any
Return whether any element is True, potentially over an axis.
append(self, other[, ignore_index, …])
append
Append rows of other to the end of caller, returning a new object.
apply(self, func[, axis, raw, result_type, args])
apply
Apply a function along an axis of the DataFrame.
applymap(self, func)
applymap
Apply a function to a Dataframe elementwise.
asfreq(self, freq[, method, fill_value])
asfreq
Convert TimeSeries to specified frequency.
asof(self, where[, subset])
asof
Return the last row(s) without any NaNs before where.
assign(self, **kwargs)
assign
Assign new columns to a DataFrame.
astype(self, dtype, copy, errors)
astype
Cast a pandas object to a specified dtype dtype.
dtype
at_time(self, time, asof[, axis])
at_time
Select values at particular time of day (e.g.
between_time(self, start_time, end_time, …)
between_time
Select values between particular times of the day (e.g., 9:00-9:30 AM).
bfill(self[, axis, limit, downcast])
bfill
Synonym for DataFrame.fillna() with method='bfill'.
DataFrame.fillna()
method='bfill'
bool(self)
bool
Return the bool of a single element PandasObject.
boxplot(self[, column, by, ax, fontsize, …])
boxplot
Make a box plot from DataFrame columns.
clip(self[, lower, upper, axis])
clip
Trim values at input threshold(s).
combine(self, other, func[, fill_value, …])
combine
Perform column-wise combine with another DataFrame.
combine_first(self, other)
combine_first
Update null elements with value in the same location in other.
convert_dtypes(self, infer_objects, …)
convert_dtypes
Convert columns to best possible dtypes using dtypes supporting pd.NA.
pd.NA
copy(self, deep)
copy
Make a copy of this object’s indices and data.
corr(self[, method, min_periods])
corr
Compute pairwise correlation of columns, excluding NA/null values.
corrwith(self, other[, axis, drop, method])
corrwith
Compute pairwise correlation.
count(self[, axis, level, numeric_only])
count
Count non-NA cells for each column or row.
cov(self[, min_periods])
cov
Compute pairwise covariance of columns, excluding NA/null values.
cummax(self[, axis, skipna])
cummax
Return cumulative maximum over a DataFrame or Series axis.
cummin(self[, axis, skipna])
cummin
Return cumulative minimum over a DataFrame or Series axis.
cumprod(self[, axis, skipna])
cumprod
Return cumulative product over a DataFrame or Series axis.
cumsum(self[, axis, skipna])
cumsum
Return cumulative sum over a DataFrame or Series axis.
describe(self[, percentiles, include, exclude])
describe
Generate descriptive statistics.
diff(self[, periods, axis])
diff
First discrete difference of element.
div(self, other[, axis, level, fill_value])
div
Get Floating division of dataframe and other, element-wise (binary operator truediv).
divide(self, other[, axis, level, fill_value])
divide
dot(self, other)
dot
Compute the matrix multiplication between the DataFrame and other.
drop(self[, labels, axis, index, columns, …])
drop
Drop specified labels from rows or columns.
drop_duplicates(self, subset, …)
drop_duplicates
Return DataFrame with duplicate rows removed.
droplevel(self, level[, axis])
droplevel
Return DataFrame with requested index / column level(s) removed.
dropna(self[, axis, how, thresh, subset, …])
dropna
Remove missing values.
duplicated(self, subset, Sequence[Hashable], …)
duplicated
Return boolean Series denoting duplicate rows.
eq(self, other[, axis, level])
eq
Get Equal to of dataframe and other, element-wise (binary operator eq).
equals(self, other)
equals
Test whether two objects contain the same elements.
eval(self, expr[, inplace])
eval
Evaluate a string describing operations on DataFrame columns.
ewm(self[, com, span, halflife, alpha, …])
ewm
Provide exponential weighted functions.
expanding(self[, min_periods, center, axis])
expanding
Provide expanding transformations.
explode(self, column, Tuple])
explode
Transform each element of a list-like to a row, replicating index values.
ffill(self[, axis, limit, downcast])
ffill
Synonym for DataFrame.fillna() with method='ffill'.
method='ffill'
fillna(self[, value, method, axis, inplace, …])
fillna
Fill NA/NaN values using the specified method.
filter(self[, items, axis])
filter
Subset the dataframe rows or columns according to the specified index labels.
first(self, offset)
first
Method to subset initial periods of time series data based on a date offset.
first_valid_index(self)
first_valid_index
Return index for first non-NA/null value.
floordiv(self, other[, axis, level, fill_value])
floordiv
Get Integer division of dataframe and other, element-wise (binary operator floordiv).
from_dict(data[, orient, dtype, columns])
from_dict
Construct DataFrame from dict of array-like or dicts.
from_records(data[, index, exclude, …])
from_records
Convert structured or record ndarray to DataFrame.
ge(self, other[, axis, level])
ge
Get Greater than or equal to of dataframe and other, element-wise (binary operator ge).
get(self, key[, default])
get
Get item from object for given key (ex: DataFrame column).
groupby(self[, by, axis, level])
groupby
Group DataFrame using a mapper or by a Series of columns.
gt(self, other[, axis, level])
gt
Get Greater than of dataframe and other, element-wise (binary operator gt).
head(self, n)
head
Return the first n rows.
hist(data[, column, by, grid, xlabelsize, …])
hist
Make a histogram of the DataFrame’s.
idxmax(self[, axis, skipna])
idxmax
Return index of first occurrence of maximum over requested axis.
idxmin(self[, axis, skipna])
idxmin
Return index of first occurrence of minimum over requested axis.
infer_objects(self)
infer_objects
Attempt to infer better dtypes for object columns.
info(self[, verbose, buf, max_cols, …])
info
Print a concise summary of a DataFrame.
insert(self, loc, column, value[, …])
insert
Insert column into DataFrame at specified location.
interpolate(self[, method, axis, limit, …])
interpolate
Interpolate values according to different methods.
isin(self, values)
isin
Whether each element in the DataFrame is contained in values.
isna(self)
isna
Detect missing values.
isnull(self)
isnull
items(self)
items
Iterate over (column name, Series) pairs.
iteritems(self)
iteritems
iterrows(self)
iterrows
Iterate over DataFrame rows as (index, Series) pairs.
itertuples(self[, index, name])
itertuples
Iterate over DataFrame rows as namedtuples.
join(self, other[, on, how, lsuffix, …])
join
Join columns of another DataFrame.
keys(self)
keys
Get the ‘info axis’ (see Indexing for more).
kurt(self[, axis, skipna, level, numeric_only])
kurt
Return unbiased kurtosis over requested axis.
kurtosis(self[, axis, skipna, level, …])
kurtosis
last(self, offset)
last
Method to subset final periods of time series data based on a date offset.
last_valid_index(self)
last_valid_index
Return index for last non-NA/null value.
le(self, other[, axis, level])
le
Get Less than or equal to of dataframe and other, element-wise (binary operator le).
lookup(self, row_labels, col_labels)
lookup
Label-based “fancy indexing” function for DataFrame.
lt(self, other[, axis, level])
lt
Get Less than of dataframe and other, element-wise (binary operator lt).
mad(self[, axis, skipna, level])
mad
Return the mean absolute deviation of the values for the requested axis.
mask(self, cond[, other, inplace, axis, …])
mask
Replace values where the condition is True.
max(self[, axis, skipna, level, numeric_only])
max
Return the maximum of the values for the requested axis.
mean(self[, axis, skipna, level, numeric_only])
mean
Return the mean of the values for the requested axis.
median(self[, axis, skipna, level, numeric_only])
median
Return the median of the values for the requested axis.
melt(self[, id_vars, value_vars, var_name, …])
melt
Unpivot a DataFrame from wide to long format, optionally leaving identifiers set.
memory_usage(self[, index, deep])
memory_usage
Return the memory usage of each column in bytes.
merge(self, right[, how, on, left_on, …])
merge
Merge DataFrame or named Series objects with a database-style join.
min(self[, axis, skipna, level, numeric_only])
min
Return the minimum of the values for the requested axis.
mod(self, other[, axis, level, fill_value])
mod
Get Modulo of dataframe and other, element-wise (binary operator mod).
mode(self[, axis, numeric_only, dropna])
mode
Get the mode(s) of each element along the selected axis.
mul(self, other[, axis, level, fill_value])
mul
Get Multiplication of dataframe and other, element-wise (binary operator mul).
multiply(self, other[, axis, level, fill_value])
multiply
ne(self, other[, axis, level])
ne
Get Not equal to of dataframe and other, element-wise (binary operator ne).
nlargest(self, n, columns[, keep])
nlargest
Return the first n rows ordered by columns in descending order.
notna(self)
notna
Detect existing (non-missing) values.
notnull(self)
notnull
nsmallest(self, n, columns[, keep])
nsmallest
Return the first n rows ordered by columns in ascending order.
nunique(self[, axis, dropna])
nunique
Count distinct observations over requested axis.
pct_change(self[, periods, fill_method, …])
pct_change
Percentage change between the current and a prior element.
pipe(self, func, *args, **kwargs)
pipe
Apply func(self, *args, **kwargs).
pivot(self[, index, columns, values])
pivot
Return reshaped DataFrame organized by given index / column values.
pivot_table(self[, values, index, columns, …])
pivot_table
Create a spreadsheet-style pivot table as a DataFrame.
plot
alias of pandas.plotting._core.PlotAccessor
pandas.plotting._core.PlotAccessor
pop(self, item)
pop
Return item and drop from frame.
pow(self, other[, axis, level, fill_value])
pow
Get Exponential power of dataframe and other, element-wise (binary operator pow).
prod(self[, axis, skipna, level, …])
prod
Return the product of the values for the requested axis.
product(self[, axis, skipna, level, …])
product
quantile(self[, q, axis, numeric_only, …])
quantile
Return values at the given quantile over requested axis.
query(self, expr[, inplace])
query
Query the columns of a DataFrame with a boolean expression.
radd(self, other[, axis, level, fill_value])
radd
Get Addition of dataframe and other, element-wise (binary operator radd).
rank(self[, axis])
rank
Compute numerical data ranks (1 through n) along axis.
rdiv(self, other[, axis, level, fill_value])
rdiv
Get Floating division of dataframe and other, element-wise (binary operator rtruediv).
reindex(self[, labels, index, columns, …])
reindex
Conform DataFrame to new index with optional filling logic.
reindex_like(self, other, method, …[, …])
reindex_like
Return an object with matching indices as other object.
rename(self[, mapper, index, columns, axis, …])
rename
Alter axes labels.
rename_axis(self[, mapper, index, columns, …])
rename_axis
Set the name of the axis for the index or columns.
reorder_levels(self, order[, axis])
reorder_levels
Rearrange index levels using input order.
replace(self[, to_replace, value, inplace, …])
replace
Replace values given in to_replace with value.
resample(self, rule[, axis, loffset, on, level])
resample
Resample time-series data.
reset_index(self, level, Sequence[Hashable], …)
reset_index
Reset the index, or a level of it.
rfloordiv(self, other[, axis, level, fill_value])
rfloordiv
Get Integer division of dataframe and other, element-wise (binary operator rfloordiv).
rmod(self, other[, axis, level, fill_value])
rmod
Get Modulo of dataframe and other, element-wise (binary operator rmod).
rmul(self, other[, axis, level, fill_value])
rmul
Get Multiplication of dataframe and other, element-wise (binary operator rmul).
rolling(self, window[, min_periods, center, …])
rolling
Provide rolling window calculations.
round(self[, decimals])
round
Round a DataFrame to a variable number of decimal places.
rpow(self, other[, axis, level, fill_value])
rpow
Get Exponential power of dataframe and other, element-wise (binary operator rpow).
rsub(self, other[, axis, level, fill_value])
rsub
Get Subtraction of dataframe and other, element-wise (binary operator rsub).
rtruediv(self, other[, axis, level, fill_value])
rtruediv
sample(self[, n, frac, replace, weights, …])
sample
Return a random sample of items from an axis of object.
select_dtypes(self[, include, exclude])
select_dtypes
Return a subset of the DataFrame’s columns based on the column dtypes.
sem(self[, axis, skipna, level, ddof, …])
sem
Return unbiased standard error of the mean over requested axis.
set_axis(self, labels[, axis, inplace])
set_axis
Assign desired index to given axis.
set_index(self, keys[, drop, append, …])
set_index
Set the DataFrame index using existing columns.
shift(self[, periods, freq, axis, fill_value])
shift
Shift index by desired number of periods with an optional time freq.
skew(self[, axis, skipna, level, numeric_only])
skew
Return unbiased skew over requested axis.
slice_shift(self, periods[, axis])
slice_shift
Equivalent to shift without copying data.
sort_index(self[, axis, level, ascending, …])
sort_index
Sort object by labels (along an axis).
sort_values(self, by[, axis, ascending, …])
sort_values
Sort by the values along either axis.
sparse
alias of pandas.core.arrays.sparse.accessor.SparseFrameAccessor
pandas.core.arrays.sparse.accessor.SparseFrameAccessor
squeeze(self[, axis])
squeeze
Squeeze 1 dimensional axis objects into scalars.
stack(self[, level, dropna])
stack
Stack the prescribed level(s) from columns to index.
std(self[, axis, skipna, level, ddof, …])
std
Return sample standard deviation over requested axis.
sub(self, other[, axis, level, fill_value])
sub
Get Subtraction of dataframe and other, element-wise (binary operator sub).
subtract(self, other[, axis, level, fill_value])
subtract
sum(self[, axis, skipna, level, …])
sum
Return the sum of the values for the requested axis.
swapaxes(self, axis1, axis2[, copy])
swapaxes
Interchange axes and swap values axes appropriately.
swaplevel(self[, i, j, axis])
swaplevel
Swap levels i and j in a MultiIndex on a particular axis.
tail(self, n)
tail
Return the last n rows.
take(self, indices[, axis])
take
Return the elements in the given positional indices along an axis.
to_clipboard(self, excel, sep, …)
to_clipboard
Copy object to the system clipboard.
to_csv(self, path_or_buf, pathlib.Path, …)
to_csv
Write object to a comma-separated values (csv) file.
to_dict(self[, orient, into])
to_dict
Convert the DataFrame to a dictionary.
to_excel(self, excel_writer[, sheet_name, …])
to_excel
Write object to an Excel sheet.
to_feather(self, path)
to_feather
Write out the binary feather-format for DataFrames.
to_gbq(self, destination_table[, …])
to_gbq
Write a DataFrame to a Google BigQuery table.
to_hdf(self, path_or_buf, key, mode, …[, …])
to_hdf
Write the contained data to an HDF5 file using HDFStore.
to_html(self[, buf, columns, col_space, …])
to_html
Render a DataFrame as an HTML table.
to_json(self, path_or_buf, pathlib.Path, …)
to_json
Convert the object to a JSON string.
to_latex(self[, buf, columns, col_space, …])
to_latex
Render object to a LaTeX tabular, longtable, or nested table/tabular.
to_markdown(self, buf, NoneType] = None, …)
to_markdown
Print DataFrame in Markdown-friendly format.
to_numpy(self[, dtype, copy])
to_numpy
Convert the DataFrame to a NumPy array.
to_parquet(self, path[, engine, …])
to_parquet
Write a DataFrame to the binary parquet format.
to_period(self[, freq, axis, copy])
to_period
Convert DataFrame from DatetimeIndex to PeriodIndex.
to_pickle(self, path, compression, …)
to_pickle
Pickle (serialize) object to file.
to_records(self[, index, column_dtypes, …])
to_records
Convert DataFrame to a NumPy record array.
to_sql(self, name, con[, schema, …])
to_sql
Write records stored in a DataFrame to a SQL database.
to_stata(self, path[, convert_dates, …])
to_stata
Export DataFrame object to Stata dta format.
to_string(self, buf, pathlib.Path, IO[str], …)
to_string
Render a DataFrame to a console-friendly tabular output.
to_timestamp(self[, freq, how, axis, copy])
to_timestamp
Cast to DatetimeIndex of timestamps, at beginning of period.
to_xarray(self)
to_xarray
Return an xarray object from the pandas object.
transform(self, func[, axis])
transform
Call func on self producing a DataFrame with transformed values.
func
transpose(self, *args, copy)
transpose
truediv(self, other[, axis, level, fill_value])
truediv
truncate(self[, before, after, axis])
truncate
Truncate a Series or DataFrame before and after some index value.
tshift(self, periods[, freq, axis])
tshift
Shift the time index, using the index’s frequency if available.
tz_convert(self, tz[, axis, level])
tz_convert
Convert tz-aware axis to target time zone.
tz_localize(self, tz[, axis, level, ambiguous])
tz_localize
Localize tz-naive index of a Series or DataFrame to target time zone.
unstack(self[, level, fill_value])
unstack
Pivot a level of the (necessarily hierarchical) index labels.
update(self, other[, join, overwrite, …])
update
Modify in place using non-NA values from another DataFrame.
var(self[, axis, skipna, level, ddof, …])
var
Return unbiased variance over requested axis.
where(self, cond[, other, inplace, axis, …])
where
Replace values where the condition is False.
xs(self, key[, axis, level])
xs
Return cross-section from the Series/DataFrame.