Conference Thread Discussions, Data Analysis and Concept Mapping

Printer-friendly version

The following subsections summarize online and on-site discussions regarding the five organizing questions for the conference. Each summary is followed by the results of data analysis and concept mapping small group activities.

#1: What theories inform your work?

Facilitator: Juan Lucena, Colorado School of Mines

In online discussions, participants pointed out how everyone is always theorizing—deductively and inductively—by looking for patterns, identifying conjectures, and otherwise developing theory. The contents of the discussions can be summarized as follows.

Socio-cultural vs. medical models of disability and universal design—where is the source of disability? Is it in the body, or does it lie in social values or inaccessible design?
Critical race, feminist, and queer pedagogy theories—how has engineering education became race-, gender-, sexual-identity blind and yet is still exclusionary?
Identity and possible selves—how do students make sense of who they are and their relationship to engineering?
Growth mindset/strength-based approach/motivation theory—How can we mentor students beyond fixed mindsets to thrive in engineering?
Funds of knowledge (FoK) à Social, cultural, and financial capital—How can we value FoKs and transform them into forms of capital?
Multiple dimensions of identity (intersectionality)—How do we understand and value these differences in engineering education?
Social constructivist approaches to privilege, marginalization, or knowledge—How do sociohistorical conditions and cultural values shape our determinations of experience, justice, or sense of certainty about either?

A current and future challenge is technical and social depoliticization. We need to consider engineering as a social-technical domain and to understand the natural order of things; who and what has been kept outside engineering; and how to resist, disturb, and poke holes in boundaries. We need to design makerspaces to be inclusive and relevant, design for affordability to support inclusive excellence, and incorporate marginalized theories and knowledge into research and design.

Group discussion at the meeting included how theorizing is a scary space, especially for pre-tenure colleagues, and the importance of using practice to inform theories. We need to consider what happens in K-12 and other places where learning occurs, such as in families and informal science activities. It is important to explore the history of theories—for example, engineering emerged from the military and yet it seems veterans have such a hard time finding a route into engineering. We should choose theories that permit people to think about change, recognizing that people are not static. We should recognize that every group has its own unique culture. We should embrace “praxis” by combining theory and practice. The belief that if something isn’t grounded in theory it is not credible should be challenged. How do we produce theory that leads to impactful work? Where do we want to go and how do we get there?

The results of the day two small group data analysis and concept mapping activities follow. A number of participants expressed anxiety and intimidation regarding the use of theory in their work. Theory was often characterized as a “scary space”, and some participants questioned the appropriateness of applying existing theories commonly used in engineering education to studying the populations in question. The hesitancy regarding the use of existing theory was due to concerns that the assumptions underpinning them are often at best, unstated, and at worst, often function to (re)produce marginalization. In particular, critical theories were suggested as an alternative because they incorporate the historical context surrounding policy and practice; participants felt that critical theories offered powerful tools to challenge exclusionary practices in educational systems. Other participants emphasized theories related to identity, change, and learning. Some participants even took an anti-theory stance suggesting that work related to these populations should not be guided by theory, but instead new theories should be generated from the data.

#2: What research methods inform your work?

Facilitator: Alice Pawley, Purdue University

In the online discussion this question led to further questions on the topic:

What are the methodical questions that we as researchers need to deal with?
How can we recognize the specific challenges for growth in methodical research?
How do we give voice to marginalized groups?
How do we coordinate multi-institutional studies to get big data in which to look for patterns?
How do we avoid replicating studies that have already been done?
How do we use qualitative research to influence STEM policy and practice?
What large data sets exist that we as a community could be using more effectively?
How do we disseminate research in authentic and true ways, while still publishing in academically accepted places?
How do we challenge talking about methods without talking about questions and populations?
What is missing; what is next?

Additionally, participants in the online discussion developed some questions for further consideration:

What methods do you think have potential for understanding different aspects of broadening participation (even if you are not an expert)?
What research questions would you ask if you didn’t have to worry about how you would actually answer them and if you didn’t need to worry about the method?
What new method have you read about that you most want to learn about?
What are the advantages and disadvantages of your current favorite method for understanding broadening participation?
What are some methodological questions we need to ask ourselves as a community?
What methods in studies do you like reading about?
What research questions do we need better methods to answer?
What do you read? Where do you get your brightest ideas?

In the conference discussion participants shared methods they tend to use; their responses ranged from the intensely quantitative to the intensely qualitative with a good amount of overlap between the two.

Participants discussed challenges and opportunities in all types of engineering research, asking multiple questions:

What world views do different research methods embody?
Can we study translation between researchers and practitioners?
How do we validate quality of work?
How do we give voice to marginalize groups?
How can we label communities as such when we are talking about them?

The results of the day two small group data analysis and concept mapping activities follow. Participants cited the many ways that research data collection, analysis, and dissemination often work to further marginalize the communities of discussion. Participants identified proposal reviewers and funding agencies as forces driving research foci and methods by controlling what research is funded. Participants expressed concern that despite the growing need for research methods capable of capturing and reporting the experiences of marginalized persons within engineering, they observed a disproportionate preference among engineering education research communities and funding agencies towards large quantitative research studies. Participants questioned the appropriateness or ability of quantitative methods to capture the stories and voices of these populations; instead participants identified qualitative research methods as being much more appropriate to capture and understand marginalized experiences. Finally, participants emphasized the need for researchers themselves to critically examine their own assumptions and values underlying their work.

#3: What research questions inform your work?

Facilitator: Donna Riley, Virginia Polytechnic Institute and State University

Key issues presented in online discussions before the meeting included the following observations:

There was a clear sense of community in the group; there were opportunities for support, collaboration, friendship, rabble-rousing, and co-conspiracy.
Most individuals who communicated on this topic are simultaneously working within categories of difference (people with disabilities; veterans/military connected folks, first generation/low income students, and LGBTQ people, as well as, in various ways, stretching or challenging those categories (e.g., studying intersectional categories like queer people of color, recognizing non-monolithic aspects of communities).

Meta-questions were also discussed:

How can we know? What is allowed/precluded with different ways of knowing or lenses of understanding and analysis? (epistemics, theories, lenses, methodologies).
What data do we need? What do we not (yet) know? What are our obstacles to finding out? (methods).
What’s it like to be…? What works and doesn’t…? (experiences and interventions).
What’s wrong and why? (critique and analysis).
etc. to….? (change theories/strategies; research to practice).

In discussions at the conference, members talked about challenges that included research to practice, the great variety of dualisms, fixed mindset, how different cultures factor in, and including humanizing empathy as part of the conversation.

The results of the day two small group data analysis and concept mapping activities follow. Participants discussed the importance of exploring how institutional structures, policies, and practices affect visibility, recognition, and inclusion for individuals from different social groups. The participants also emphasized research questions that worked to create inclusive campus and engineering environments and utilized co-constructive methods. Finally, participants believe both researcher and practitioner knowledge should inform research questions in ways that break down normative culture to lessen barriers and marginalization of individuals from underrepresented groups.

#4: What educational practices or experiences inform your research?

Facilitator: Darryl Williams, Director, Tufts University

In general, the responses to this online thread focused primarily on experiences that inform participants’ research. For example:

The responses were mixed, focusing on individual lived experiences versus vicarious experiences (recognizing challenges of others) that seem to fuel participants’ particular research foci.
Common words that were used in the online discussion were:
- Experience/experiences – discrimination, marginalization, or feeling undervalued, overlooked, and encounters with other forms of bias
- Student/Students - (recalling an educational experience that happened to them, or their outlook on research and the impact it will have in the future on marginalized student populations)
- “Being” - as in existence (or nature/essence of) – and in being, recalling points in time feeling “out of place,” “on the fringes,” and wanting to be fully integrated in an environment
Hidden identities in the context of systems that support visible identities (the intersectionality of the two) and the relationship of hidden identities to mental health issues
Stereotype threat, performance-avoidance; imposter syndrome and having a fully expressed identity
The impact of negative, discouraging feedback from peers and professionals (academic, industry)
Notion that academic systems work to obscure experiences of discrimination
The importance and role of community (power of the collective) in connecting people of similar experience, backgrounds, identities to cope with social and academic challenges
Moving from a superficial level of diversity in engineering to understanding its cultural nuances in order to truly realize diversity.
Diversity means nothing without inclusion.

With respect to practices, participants expressed the following sentiments:

From research to practice, the need to support efforts that work WITH teachers rather than DONE TO teachers; research that samples interventions across diverse learning environments (urban, suburban, rural) to provide a greater level of confidence in findings for implementation in formal classrooms
More attention to understanding the principles of universal design (e.g., for learning and of technology) and how it can benefit all students and make learning more accessible

In the discussion at the conference participants explored the importance of working within cohorts or mentoring groups and across disciplines, how to retain people in the community, the possibilities for using social media, and how to think about individual pathways in engineering (interest, preparation, quality of experiences, and interactions on their journey). They explored the concepts of a person’s engineering identity, how is it developed (or not), and the culture of engineering. They discussed the need to value highly and address diversity issues throughout both K-12 and higher education. They discussed the importance of retaining students in engineering—we’ve opened the door and while it remains open, we need to make them feel welcome and want to stay. There is a need for more ongoing funding and other support from institutions to continue mentoring and undertake other practices that show positive outcomes for broadening participation. There is also a need to support students as they transition into college and the workforce and for a database with profiles on a large scale so students can see how others have overcome similar barriers to achieve success. It is important to consider how the intersectionality of race/class/gender/disability layers play out.

Five constructs can be used to inform educational practices:

Interest in engineering, K-12
Preparation so that students are prepared to make it to the next level
Experiences that are high quality
Relationships that matter
Opportunities once the first four constructs are in place

The results of the day two small group data analysis and concept mapping activities follow. Participants discussed and highlighted institutional structures that act as barriers preventing students in these populations from participating fully; namely the policies and cultural norms of engineering education defining the very narrow range of identities that align with what/who an engineer is. The participants also emphasized how such institutional barriers can be reduced when institutions of higher education and engineering departments make inclusion a priority and engage in diversity and inclusion efforts and by making classrooms accessible and incorporating these themes into the curriculum. Finally, participants called for a stronger path for research to inform practice and program development as well as research being informed by practice.

#5: What are the things you wish you knew to do your educational practice better?

Facilitator: Karl Booksch, University of Delaware

Things online participants reported that they wished they knew to do their educational practice better included the following:

How to fully understand the policy and practice implications of our project results
Research-based support services
Challenges engineering faculty members face in teaching students with various characteristics
Methods to ensure that all engineering curriculum and instruction is accessible to students with disabilities
Research-based practices that can be integrated into postsecondary engineering curriculum and instruction
Educational research results that are presented and documented to be more accessible to engineering instructors (e.g., use of personas from human centered design)
Reports of the experiences of students with disabilities in research studies to determine if the methods studies are effective for this subgroup of participants
How to address shortcomings with respect to social skills of engineers
Access to meta-analysis and review papers on related topics
Increased understanding of underrepresentation of a broad range of groups as well as issues related to intersectionality
How current research methods and reports marginalize some underrepresented groups
What theories, critical questions and methodologies can promote the best research and practice regarding underrepresented groups in engineering
How to build an effective, inclusive engineering community
What resources, infrastructure, programs, etc., are needed to broaden participation in engineering
Tools and resources to navigate engineering cultural and political practices
Where to get funding for research and practice

At the conference participants discussed how to get an institution beyond minimal compliance or diversity to true inclusion. How do we get high level administrators to buy in and support best practices that work for the institution? What are ways to implement best practices? How can we, within small groups, meet individual needs? Concern was expressed that theory can be used as a gatekeeper for practices to be accepted. Terminology such as “best practices” should be used rarely in favor of “promising practices” or “evidence-based practices” because these terms more accurately reflect the level of evidence we have for the practices we use.

The results of the day two small group data analysis and concept mapping activities follow. Participants were looking for guidance on how to create and sustain institutional change on all levels of educations (i.e. K-12, college, as a researcher/practitioner, in one’s professional practice). They also questioned how to challenge the existing stigmas and norms within engineering to help shift the culture towards a more inclusive environment. In particular, participants wondered how to achieve buy-in and find out who could act as their partners and allies in these efforts; some participants characterized the work of challenging the system of engineering education as treacherous journey for a new faculty member or researcher.