Resources for secondary analysis / extant data

Qualitative research: standards, challenges, and guidelines

http://www.allgemeinmedizin.med.uni-goettingen.de/literatur/Qual/Qual_stand_chall_01.pdf

Asking New Questions of Existing Qualitative Data: Annotated
Bibliography Regarding Secondary Analysis of Qualitative Data


http://www.ncfr.org/pdf/radinabib.pdf

Re-using qualitative data

http://www.esds.ac.uk/qualidata/support/reusearticles.asp

Murray Research Archive : For Students – Ways Researchers Use Archived Data

http://www.murray.harvard.edu/mra/service.jsp?id=52&bct=dData%252BAccess.p8.s52

The Shared Fate of Two Innovations in Qualitative Methodology: The Relationship of Qualitative Software and Secondary Analysis of Archived Qualitative Data

http://qualitative-research.net/fqs-texte/3-00/3-00fielding-e.htm

Secondary Analysis of Qualitative Data

http://qualitative-research.net/fqs/fqs-e/inhalt1-05-e.htm

On the Potentials and Problems of Secondary Analysis. An Introduction to the FQS Special Issue on Secondary Analysis of Qualitative Data

http://qualitative-research.net/fqs-texte/1-05/05-1-49-e.htm

Using Someone Else’s Data: Problems, Pragmatics and Provisions

http://qualitative-research.net/fqs-texte/1-05/05-1-39-e.htm

Literature about storing, digitalizing and secondary analysis of qualitative data

http://medard.institut.cz/engliter.htm

Qualitative Research in Adult, Career, and Career-Technical Education

http://www.cete.org/acve/docs/pfile05.htm

Using Secondary Data for Needs Assessment
http://edis.ifas.ufl.edu/PD010

Accessibility/Usability Validators — Readings

MIT’s Usability Guidelines

Accessibility / Usability Information from Anitra Pavka

Cynthia Says – web page accessibility checker

Accessify – Online Accessibility Resources

Web XACT – 508 / WAI 1,2,3 Analysis Tool

A great interview with Joe Clark, web accessibility master/guru/expert/etc.

W3C HTML Validator

W3C Link Checker (it will tell you if you have any “bad” links)

Color blind simulator

Frequent web page accessibility issues:

  • Frames — oftentimes, developers use frames as a convenient means to separate data sets. Frames are usually a virtual roadblock for users with visual impairments due to incompatibility with screen reader technology.
  • Alt tags — Alt tags are used to describe images. If an image is used to provide a user with content then the tag needs to correctly identify the image. If an image is used as a design element then the tag needs to be coded as alt=””. This will allow screen readers to pass over an image without wasting a user’s time.
  • CSS/XHTML –Structured markup will ensure that when images and formatting are removed, the content of a site will still be accessible for all users.
    Skip navigation links — If navigational menus are duplicated on all pages of a website than a developer should always provide the user with a means to skip the duplicated menu. This will create a heightened usability factor for your user.
  • New windows — When a web site opens a new window, a user’s navigation ability can be severely decreased. The back button becomes useless and the ability to navigate to the previous page becomes impossible.

A List Apart: Source for web standards information
http://www.alistapart.com/topics/accessibility/

Assistive Technology Act of 1998
http://section508.gov/docs/AT1998.html

Information Technology Technical Assistance and Training Center (ITTATC):
National Assessment of State E&IT Accessibility Initiatives
http://www.ittatc.org/laws/state_intro.cfm

International Center for Disability Resources on the Internet
http://www.icdri.org/

Making Web Sites Work for People With Disabilities
http://chronicle.com/prm/weekly/v47/i21/21a03001.htm

National Institute on Disability and Rehabilitation Research (NIDRR)
http://www.ed.gov/rschstat/research/pubs/programs.html

Opera: a web browser with several accessibility features
http://opera.com/features/access/

Oregon State University online accessibility documentation
http://www.oregonstate.edu/accessibility

Section 508 Information
http://www.section508.gov

Spazowham Design — “we build sites from raw, organic table-free XHTML and CSS, 100% validated, compliant to W3C standards and Section 508, and ready to run in any browser on any device.”
http://www.spazowham.com/

WebAIM: Accessibility in Mind — Free online accessibility tools
http://www.webaim.org/techniques/articles/freetools/

WebAIM: Accessibility in Mind — Section 508 Web Accessibility Checklist
http://www.webaim.org/standards/508/508checklist.pdf

Web-Based Information and Prospective Students with Disabilities:
A Study of Liberal Arts Colleges
http://www.educause.edu/apps/eq/eqm04/eqm0446.asp

Assessment project

The following are excerpts and downloadables from my assessment project (OSU web page usability: An assessment of the OSU primary homepages) for my Asssessment class. The project scope and title changed a few times, but I learned a great deal about online surveys, multicultural competence, and data analysis.

I am including my final thoughts and reflections.

From my initial proposal for the assessment project for my Assessment class, OSU web page cultural usability: An assessment of the experience of the first-year Native American student web user

Strengths and limitations

There are several strengths to this assessment. The major benefit is focus. The scale is manageable. The caveat to a scale of this size is the potential for limited data. I plan on creating an easy to use questionnaire that should help expedite my return rate. The salience of the topic could make this assessment extremely pertinent to Native American students at OSU. The students who participate have the opportunity to make a lot of change happen. This could be thought of as a pilot which could be used to assess web pages at multiple levels within multiple populations

There are significant limitations to this assessment. The first issue is a general lack of knowledge of the population by the assessor. I will do my best to provide culturally appropriate questions but I feel very limited in this regard. This issue, in my opinion, provides for the potential for a negative experience for the student respondents. We were given the mandate of creating a culturally impactful project without the foundational aspects of cultural education.

The second issue to this assessment is the fact that it exists in the context of a homework assignment. How many individuals will utilize the data they have gathered to affect meaningful change? I personally will guarantee that my findings will be used to further a dialogue on the cultural usability of OSU web pages.

From the final paper for my assessment project:

Reflection regarding the assessment process
Throughout this process, I was concerned with the overall well-being of my participants. I made every effort to not marginalize or tokenize anyone who was involved with this process. My relationship with the Native American Longhouse and representatives from the Indian Education Office were strained due to an early miscommunication. I would work to build a strong bridge before I tried to cross a river.

I’m not sure if I succeeded entirely, but I do know that I have made connections which will continue to flourish long after this assessment project is a distant memory of my spring term.

I still have a lot to learn about assessment. I usually learn best when I’m “getting my hands dirty.” My lack of statistical wizardry has really reared its ugly head for this project. I may need a research methods course if I am show continued growth in this area. I would increase my overall analysis and I’d especially include cross-tabulation.

Questionpro.com is probably the nicest online survey tool that I was able to test. It allowed me the freedom to modify html, generate PDF’s, and upload custom images. I would highly recommend it for anyone who has to conduct an online survey. I merely touched the surface of its functionality. I did branch one question. If respondents said that they had not used any of the five pages then they were directed to a Thank You for participating page.

This process challenged me but in the end I feel enriched and I cannot wait until my next assessment project.

Final Presentation PowerPoint

Enrollment Management tech

Final paper for my Disability Issues class:

Functional Area

Enrollment Management – Topic: Online portals and accessibility

What is Enrollment Management (EM)?

Enrollment Management departments actively identify, counsel, recruit, and
enroll qualified students; and offer services that promote student retention
and success. Enrollment Management emerged as a new field in Student Affairs
in the 1980s.

Enrollment Management Organizational Example
At Oregon State University, EM consists of 6 units: Admissions, Student Orientation
and Retention Programs (SOAR), Registrar, Financial Aid and Scholarships,
SMILE, and Precollege Programs.

Strategic Enrollment Management concepts

  • Establishing clear goals for the number and types of students needed to
    fulfill the institutional mission.
  • Promoting academic success by improving student access, transition, persistence,
    and graduation.
  • Determining, achieving, and maintaining optimum enrollment.
  • Enabling the delivery of effective academic programs.
  • Generating added net revenue for the institution.
  • Enabling effective financial planning.
  • Increasing process and organizational efficiency.
  • Improving service levels to all stakeholders (e.g., prospective and current
    students, other institutional departments, other institutions, coordinating
    agencies).
  • Creating a data-rich environment to inform decisions and
    evaluate strategies. [We add analysis-rich too as many institutions
    are data-rich with the student information systems in place,
    yet a parallel investment has not often been made on analyzing
    the still “invisible” relationships].
  • Creating and continuously strengthening linkages with functions and activities
    across the campus.

(From “Strategic Enrollment Management: Core Strategies and Best Practices,” by
Bob Bontrager, 2004, College and University Journal, 79(4), 9 – 15.)


Enrollment Management and Online Portals
As new technologies emerge; Enrollment Management departments strive
to expand online services for their students. Through the use of online portals,
EM departments continue to strategically utilize technology to increase student
persistence and retention. Online portals are also useful in increasing student
satisfaction, institutional efficiency, and online service deliverables (Harr,
2002).

What is an online portal?
An online portal is defined as “an abridged and customized
version of the institutional Web presence… a "pocket-sized" version
of the campus Web. Portal technology adds "customization" and "community" to
the campus Web presence. Customization allows each user to define a unique
and personal view of the campus Web. Community tools, such as chat, forums,
survey, and so on, build relationships among campus constituencies” (
UPortal by JA-SIG)

Online Portals and Accessibility

The creators of most online portal applications state that they provide accessible
online solutions. SCT, the creators of the Luminis online portal state that
they are “committed to making the SCT Luminis product family increasingly
accessible for people with disabilities and more user-friendly for everyone.
Accessibility doctrine requires that all people, including those with disabilities,
have equal access to information technology through the implementation of a
universal design standard” (Sungard SCT, 2005). According to Blackboard,
another online portal vendor, “Blackboard is committed to the accessibility
of our e-Education platform. We are working with leaders in the accessibility
field to contemplate industry standards and federal guidelines for accessibility” (Accessibility).
In addition, WebCT, a worldwide leader in e-learning systems states that “WebCT’s
e-learning systems are World Wide Web Consortium (W3C) Priority 1 compliant
and adhere to Section 508 of the Americans with Disabilities Act” (WebCT
Accessibility).

Frequent accessibility issues with online portals

  • Frames – oftentimes, developers use frames as a convenient
    means to separate data sets. Frames are usually
    a virtual roadblock for users with visual impairments due to
    incompatibility with screen reader technology.
  • Alt tags – Alt tags are used to describe images. If an image is used
    to provide a user with content then the tag needs to correctly identify the
    image. If an image is used as a design element then the tag needs to be coded
    as alt=””. This will allow screen readers to pass over an image
    without wasting a user’s time.
  • CSS/XHTML – The use of structured markup is usually
    lacking on an online portal. Structured markup will ensure
    that when images and formatting are removed, the content
    of a site will still be accessible for all users.
  • Skip navigation links – If navigational menus are
    duplicated on all pages of a website than a developer should
    always provide the user with a means to skip the duplicated
    menu. This will create a heightened usability factor for your
    user.
  • New windows – When an online portal opens a new window, a user’s
    navigation ability can be severely decreased. The
    back button becomes useless and the ability to navigate to
    the previous page becomes impossible.
  • JavaScript – To achieve certain functionality, online portal developers
    have relied extensively on JavaScript. Unfortunately, this takes away the
    choice of browser options for most users. SCT’s
    Luminis becomes ineffective if JavaScript is turned
    off.

Note: SCT’s Luminis is currently in use by over 200
colleges and universities. Luminis contains frames, has improperly coded alt
tags, does not utilize CSS/XHTML markup, is missing skip navigation links,
opens new windows, and does not work if you turn off JavaScript. According
to SCT, “Future testing may include expanding client contact with schools
who are concerned about accessibility and feedback from users who face accessibility
challenges of all kinds” (Sungard SCT, 2005).

ADA and Section 508 Requirements

ADA : The interpretability
of the ADA can be both a benefit and a detriment to users with disabilities.
Title II of the Americans with Disabilities Act of 1990 (Title II) requires
a public college to take appropriate steps to ensure that communications with
persons with disabilities "are as effective as communications with others" [28
C.F.R. § 35.160(a)]. OCR has repeatedly held that the terms "communication" in
this context means the transfer of information, including (but not limited
to) the verbal presentation of a lecturer, the printed text of a book, and
the resources of the Internet (California State University, Long Beach – Docket
Number 09-99-2041, 1999). Most colleges and universities attempt to comply
with the ADA but most fail to provide absolute accessibility with online services.
It can be posited that the lack of disability studies curriculum in computer
science, information systems, and education programs has led to a general lack
of support and understanding for online accessibility.

Section 508: Section 508 is part of the Rehabilitation Act
of 1973. It is intended to end discrimination against people who have disabilities
within the context of technological access. Section 508 officially became U.S.
law in 2001 (Zeldman, 2003).

Section 508 Internet component:
1194.22 Web-based intranet and internet information and applications.

(a) A text equivalent for every non-text element shall be
provided (e.g., via "alt", "longdesc", or in element content).

(b) Equivalent alternatives for any multimedia presentation
shall be synchronized with the presentation.

(c) Web pages shall be designed so that all information conveyed
with color is also available without color, for example from context or markup.

(d) Documents shall be organized so they are readable without
requiring an associated style sheet.

(e) Redundant text links shall be provided for each active
region of a server-side image map.

(f) Client-side image maps shall be provided instead of server-side
image maps except where the regions cannot be defined with an available geometric
shape.

(g) Row and column headers shall be identified for data tables.

(h) Markup shall be used to associate data cells and header
cells for data tables that have two or more logical levels of row or column
headers.

(i) Frames shall be titled with text that facilitates frame
identification and navigation.

(j) Pages shall be designed to avoid causing the screen to
flicker with a frequency greater than 2 Hz and lower than 55 Hz.

(k) A text-only page, with equivalent information or functionality,
shall be provided to make a web site comply with the provisions of this part,
when compliance cannot be accomplished in any other way. The content of the
text- only page shall be updated whenever the primary page changes.

(l) When pages utilize scripting languages to display content,
or to create interface elements, the information provided by the script shall
be identified with functional text that can be read by assistive technology.

(m) When a web page requires that an applet, plug-in or other
application be present on the client system to interpret page content, the
page must provide a link to a plug-in or applet that complies with §1194.21(a)
through (l).

(n) When electronic forms are designed to be completed on-line,
the form shall allow people using assistive technology to access the information,
field elements, and functionality required for completion and submission of
the form, including all directions and cues.

(o) A method shall be provided that permits users to skip
repetitive navigation links.

(p) When a timed response is required, the user shall be
alerted and given sufficient time to indicate more time is required.

(Web-based intranet and internet information and applications, 2002)

 

Software for website accessibility assessment

Software Tool

Evaluation Category

IBM – aDesigner

Accessibility and Vision tests

IBM – Home Page Reader v3.02

 

User Test(assistive technology)

Dolphin Access – Supernova Pro v5.1

 

User Test(assistive technology)

Lynx

User Test

(From Oregon State University Technology Access Program)

Why should online portals conform to web standards?

Coding using standards (particularly CSS for positioning, and strict HTML)
makes accessibility an easier goal to achieve , as standards have been created
with accessibility in mind. Being able to address accessibility issues means
being able to serve web content to a larger audience, increasing web site efficiency,
especially for users with disabilities.

Additional resources/readings

A List Apart: Source for web standards information
http://www.alistapart.com/topics/userscience/accessibility/

Assistive Technology Act of 1998
http://section508.gov/docs/AT1998.html

Information Technology Technical Assistance and Training Center (ITTATC):
National Assessment of State E&IT Accessibility Initiatives

http://www.ittatc.org/laws/state_intro.cfm

International Center for Disability Resources on the Internet

http://www.icdri.org/

Making Web Sites Work for People With Disabilities

http://chronicle.com/prm/weekly/v47/i21/21a03001.htm

National Institute on Disability and Rehabilitation Research (NIDRR)

http://www.ed.gov/rschstat/research/pubs/programs.html

Opera: a web browser with several accessibility features

http://opera.com/features/access/

Oregon State University online accessibility documentation

http://www.oregonstate.edu/accessibility

Section 508 Information

http://www.section508.gov

Spazowham Design – “we build sites from raw, organic table-free
XHTML and CSS, 100% validated, compliant to W3C standards and Section 508,
and ready to run in any browser on any device.”

http://www.spazowham.com/

Texas Tech University Enrollment Management Plan 2002- 2006 http://www.ttu.edu/enrmgt/emplan/

WebAIM: Accessibility in Mind – Free online accessibility tools

http://www.webaim.org/techniques/articles/freetools/

WebAIM: Accessibility in Mind – Section 508 Web Accessibility Checklist

http://www.webaim.org/standards/508/508checklist.pdf

Web-Based Information and Prospective Students with Disabilities:
A Study of Liberal Arts Colleges

http://www.educause.edu/apps/eq/eqm04/eqm0446.asp

References

Blackboard Inc., (n.d.). Accessibility. Retrieved Apr. 22, 2005 , from Accessibility
FAQ’s Web site: http://www.blackboard.com/products/access/faqs.htm.

Bontrager, Bob . (2004). Strategic Enrollment Management: Core Strategies
and Best Practices. College and University Journal, 79(4), 9 – 15 .

California state university, long beach – docket number 09-99-2041. (1999).
Retrieved Apr. 24, 2005 , from http://www.icdri.org/legal/lbeach.htm.

Harr, G. L. (2002). Connections: a comprehensive student portal. concept
paper and proposal…

Sungard SCT. (2005). SCT luminis product family and accessibility [Brochure].
Malvern , PA

Uportal by ja-sig. (n.d.). Retrieved Apr. 23, 2005 , from http://www.uportal.org/index.html.

WebCT, (n.d.). WebCT accessibility. Retrieved Apr. 21, 2005 , from WebCT
Accessibility> Home Web site: http://www.webct.com/accessibility.

Web-based intranet and internet information and applications. (2002). Retrieved
Apr. 21, 2005 , from Section 508: Section 508 Standards Web site: http://www.section508.gov/index.cfm?FuseAction=Content&ID=12#Web.

Zeldman, J. (2003). Designing with web standards. Berkeley , CA
: New Riders.

Intro to Dreamweaver

Things to know before you start Dreamweaving —
• Onid web space: http://www.onid.orst.edu/docs/use/web.shtml

• FTP = File Transfer Protocol: Transferring files from your computer to a web server.

• Local vs. Remote

• File paths

• HTML is a programming language. HyperText Markup Language
http://archive.ncsa.uiuc.edu/General/Internet/WWW/HTMLPrimerP1.html

• CSS stands for Cascading Style Sheets. Used for design and layout.

• How do links work? Open new window?
• How do you display an image?

• Tables

• Index.html or .htm

• CSS Templates

• View Source

• Web graphics: gifs/jpegs

Dreamweaver MX 2004
• WYSIWYG editor

• Intro to the workspace
• Site View
• Properties

• Modify page properties
o Title
o Fonts
o Links
o Background

• Macromedia Exchange and Macromedia Extensions

• Dreamweaver and pre-made templates and create your own templates

Technology articles for student affairs practitioners

Using an Online Immersion to Teach and Learn about Student Affairs and Technology
http://studentaffairs.com/ejournal/summer_2005/UsingOnlineImmersion.html

Extreme Makeover: Technology’s Effect on Student Affairs
http://www.studentaffairs.com/ejournal/Winter_2005/ExtremeMakeover.html

The Net Generation Goes to College
http://chronicle.com/weekly/v52/i07/07a03401.htm

Technology Workshops: A few thoughts

It’s going as well as can be expected when you are trying to teach your peers. The respect levels ebb and flow.

The attendance has been very steady. 10+ people each time. The hardest thing is trying to extract the technical info from my own cortext and then articulate it to users with varying skill levels.

I would say I feel like I am facilitating more than I am teaching. The workshops are so technical in nature and the motivation for most people is their portfolio. This does dishearten me from time to time. I would like people to see technology as a necessity for their future roles as SA professionals. Instead everyone has a very narrow view. I’ve tried to convey the importance of technology awareness but it seems lost in the “I need to know this stuff so I can make an awesome portfolio” shuffle.

I’ve received some decent feedback. People have given me cues as to what works and what does not.