Overview of the IDB Analyzer

Overview of the IDB Analyzer
Andrés Sandoval-Hernández – IEA DPC
Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets
Ispra, Italy- June 24-27, 2014
Note: These slides were prepared as part of the IEA training portfolio with the collaboration of IEA staff and resource persons.
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
2
Introduction to IEA IDB Analyzer
• What is IEA IDB Analyzer?
– A software program developed by the IEA Data Processing
and Research Center for analyzing data from all IEA surveys,
(CivED, TIMSS, PIRLS, ICCS, TEDS-M, ICILS, SITES) and OECD
studies (PISA, PIAAC, TALIS) and some cross-organizational
studies (IALS, ALLS)
– Handles complex sample designs and makes use of plausible
value methodology (not used in TALIS!)
– Calculates correct standard errors when conducting analysis
with large-scale surveys
– Uses optimized algorithms for computing means,
percentages and regressions and other statistics
3
Introduction to IEA IDB Analyzer
• BONUS!
– Easy creation of data sets for use in SPSS
– Merging countries and/or data levels
– Selection of analysis variables
4
What does it do?
• Compute estimates of percentages, means, percentiles,
correlations, and linear regression parameters,
including their respective standard errors
• Can handle properly the sampling and study-specific
method to compute the correct standard errors
• Possibility to select more than one analysis variable
when computing means
• Creates enhanced SPSS output on-screen and SPSS data
file and Excel output file in the working folder
• Creates graphs for the descriptive analyses
5
Requirements
• Windows XP or higher, SPSS 15 or higher, .NET 4 and
Microsoft Excel needs to be installed beforehand
• Administrator rights are required for installation
process but not for use
6
Why Do We Need IDB Analyzer?
Very common question: “Why can’t I just do this in
SPSS?”
Answer: “Because of the data structure!”
– Sampling is multi-stage, clustered, and stratified which can
not be handled correctly by SPSS (remember the sample
design presentation!)
– SPSS can not do variance estimation using replication
methods
– The plausible values
IDB Analyzer handles these issues and “adds” the missing
features to SPSS
7
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
8
Installation walkthrough
• Double click on the setup file
(C:\EU_Workshop\Software\IEA_IDBAnalyzer_Setup_v3.1.14.exe)
9
Installation walkthrough
• Follow through the wizard windows to a successful installation
10
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
11
How to Open the IDB Analyzer
•
Start  All Programs  IEA  IDBAnalyzerV3 
IEA IDBAnalyzer
12
What you will see…
One integrated
environment, two modules
Prepare data for
analysis
Conduct analysis
Help Manual
13
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
• Merge Module
• Analysis Module
14
Merging Data Files
• Merge module
• Merges data from different respondents (e.g. in TALIS: school
and teacher) and different countries
• Select source files
• Select participants
• Select variables
• Define the output (merged) file
• Create and save SPSS syntax for merging the data
• Execute the SPSS syntax to produce the merged dataset
15
Merge Module
Select...
C:\EU_Workshop\Data
Data
Source
Directory
16
Merge Module
Select...
Data
Source
Directory
PIAAC
PIAAC Cycle 1
Participants
17
Merge Module
Select...
Data
Source
Directory
Participants
18
Merge Module
You can search by
name or description
3
2
1
Select...
File Types
Variables
19
Merge Module
Define File
Name and
Save
20
Merge Module
Syntax file is automatically stored in specified
directory AND SPSS, the created syntax file is
automatically opened
21
Merge Module
•
From the SPSS syntax editor choose:
– Run > All
– The syntax is executed and the merged file is saved under the location
you have chose in the last step of the IDB Analyzer Merge Module
22
Merge Module
23
Table of contents
• Introduction to the IEA IDB Analyzer
• Installation walkthrough
• Use of the IDB Analyzer
• Merge Module
• Analysis Module
24
Analyzing data with the IEA IDB Analyzer
25
Overview of the Analysis Module
Choose file
containing the
data for
analysis
26
Overview of the Analysis Module
27
Overview of the Analysis Module
• Percentages and Means
– Computes the percentages within specified subgroups and their
mean and standard deviation on the continuous variable selected
– Also computes the appropriate standard errors for those
percentages, means and standard deviations
28
Overview of the Analysis Module
• Percentages Only
– Computes the percentages within specified subgroups
– Computes the appropriate standard errors for those percentages
29
Overview of the Analysis Module
• Regression
– Computes a simple or multiple linear regression between a
dependent variable and a set of independent variables
– Can apply dummy and effect coding on the fly to test for
differences across groups
– Computes the regression coefficients and their corresponding
standard errors
30
Overview of the Analysis Module
• Correlations
– Calculates correlation coefficients between selected analysis
variables their standard errors
31
Overview of the Analysis Module
• Percentiles
– Calculates the score points that separate a given percentage
of the distribution of a variable, by subgroups defined by the
grouping variables with the respective standard errors
32
Overview of the Analysis Module
Mandatory for all
analysis types
33
Overview of the Analysis Module
Applies to:
Percentages and Means
Regression
Correlations
Percentiles
34
Overview of the Analysis Module
Applies to:
Regression
35
Overview of the Analysis Module
Select
variables of
interest
Search for
variable by
name or
label
36
Overview of the Analysis Module
Selected
automatically
when file is
opened
37
Overview of the Analysis Module
Add or
remove
variables
38
Overview of the Analysis Module
Choose the
desired number of
decimals in the
output
39
Overview of the Analysis Module
Define the
location of the
output files to
be produced
40
Overview of the Analysis Module
Start SPSS and
produce syntax
41
Any Questions?
Thank you for your attention!
42