{"id":647,"date":"2018-04-28T08:39:31","date_gmt":"2018-04-28T06:39:31","guid":{"rendered":"https:\/\/eaa-online.org\/arc\/blog\/blog\/pandas-and-hierarchical-indexing\/"},"modified":"2018-04-28T08:39:31","modified_gmt":"2018-04-28T06:39:31","slug":"pandas-and-hierarchical-indexing","status":"publish","type":"post","link":"https:\/\/eaa-online.org\/arc\/blog\/2018\/04\/28\/pandas-and-hierarchical-indexing\/","title":{"rendered":"Pandas and Hierarchical Indexing"},"content":{"rendered":"
\n\tPandas' ability to index data offers additional power to the way you work with data. More interesting is pandas' hierarchical indexing feature, it allows you to slice and dice data in convenient ways.<\/div>\n
\n\t <\/div>\n
\n\tPython and pandas allow you to manage data more efficiently and effectively than, say, Stata. One important problem with Stata is that you have all your data in one large file. As a result your work-file tends to grow, and thus gets messy.<\/div>\n
\n\t <\/div>\n

\n\tEfficient data management<\/h4>\n
\n\t <\/div>\n
\n\tPython and pandas store data in various ways, e.g. in lists, tuples, sets, dictionaries, DataFrames and Series. This is super efficient: each data item can be stored in its most efficient form.<\/div>\n
\n\t <\/div>\n
\n\tOn top of that, for pandas there is indexing<\/strong> and hierarchical indexing<\/strong>. These features offer you the ability to focus on specific data sets within a single DataFrame. For example, your DataFrame may contain firm identification information, such as names and permcos, adjacent to numerical data. If you want to analyze the numbers, items such as names and permcos stand in the way. Hierarchical Indexing offers you a solution: you can set an index in such a way that your analysis only examines the numbers and ignore names and other non-numerical data.<\/div>\n
\n\t <\/div>\n
\n\tIndexing also allows you to quickly produce tables, (which then can be used as new DataFrames, etc).<\/div>\n
\n\t <\/div>\n
\n\tAn additional feature of indexing is that you can use it to merge files quickly.<\/div>\n
\n\t <\/div>\n

\n\tThe examples here:<\/h4>\n