Volume 2, Paper 14
                   September 1999
 
 
OPINION

 
 

AN IS RESEARCH RELEVANCE MANIFESTO1

Ralph D. Westfall
College of Business Administration
California Polytechnic University, Pomona
westfalr@acm.org
 
 
 
 

ABSTRACT

Many practitioners believe academic IS research is not relevant. I argue that our research, and the underlying rewards system that drives it, needs to respond to these concerns. We need to be more relevant to meet the increasing needs of our students, the organizations that hire them, and the larger society. To analyze the issues, I develop three different scenarios of where the IS field could be 10 years from now. The following visions of the future identify the implications of different levels of adaptation to relevance-related environmental pressures.
  Scenario 1: Minimal Adaptation. The IS field is shrinking, largely due to competition from newly established schools of information technology. The traditional paper-based journals continue to dominate. Their slow publication cycles, in contrast to the rapid rate of change in the IT industries, mean that most technical topics and many current managerial issues are excluded from the research that generates the greatest institutional rewards. However a market analysis indicates that we can still do relevant research in categories such as: 1) issues contrary to commercial interests; 2) unsolved problems; 3) issues economically unattractive to commercial researchers; 4) issues where management aspects are more important than technical aspects; and 5) research on teaching IS.   Scenario 2: Moderate Adaptation. The IS field is approximately the same size, even though demand for graduates with IT skills is greater. The journals expand the subset of topics in which IS researchers can generate relevant contributions, by improving publishing cycle times. Adaptive responses include: 1) increasing electronic access to journal contents; 2) reducing review cycle times; 3) involving practitioners in reviews; and 4) revising norms for style and tone.   Scenario 3: High Adaptation. The IS field is larger than before, growing in proportion to the demand for graduates with IT skills. Academia is facing tremendous pressures, many of which are driven or influenced by IT developments. These developments enable changes in the IS field such as: 1) including technical competence in evaluation criteria; 2) rewarding publishing in practitioner-oriented outlets; and 3) involving practitioners in substantive IS program issues.   Scenario 1 is the "do nothing" alternative. Scenarios 2 and 3 represent substantial improvements, but they will not occur unless we act vigorously to improve our position.

Keywords: relevance, rigor, IS research, IS practitioners, technical skills, publishing outlets, professional evaluation, IS education
 

 
I. INTRODUCTION
How relevant should IS research be to practitioners? This question is becoming a "hot button issue." A number of prominent IS academics [including Robey and Markus, 1998; Senn, 1998; and Mandviwalla and Gray, 1998] expressed their opinions on the subject in a special issue of Information Resources Management Journal in early 1998. Five papers on the same topic appeared in the March 1999 issue of MIS Quarterly [Applegate and King, 1999; Benbasat and Zmud, 1999; Davenport and Markus, 1999; Lee, 1999b; Lyytinen, 1999].

Joseph Williams [1999] posted a comment on the ISWorld list server in April 1999, regarding the irony of a two-year cycle time for a proposed theme issue of MIS Quarterly on "Redefining the Organizational Roles of Information Technology in the Information Age." The post led to a flurry of responses, largely supportive of Williams’ position, including one from Blake Ives [1999] subtitled "The Emperor Has No Clothes."

One way to analyze the issue is to use scenario planning, a tool that can help identify and analyze environmental pressures and their implications. The analyst develops scenarios that "describe how the major economic, social, political, and technological driving forces might plausibly combine to shape the future" [Schwartz, 1992, p. 5]. Section II of the paper offers three visions, based on the current situation and visible trends, of possible alternative futures for the IS field in the next ten years. Each scenario includes a discussion of the underlying assumptions and their implications, and outlines strategies for maximizing relevance under the constraints of that scenario.

Section III provides a discussion of previous research and commentary on the issue of relevance in IS research, referring to some of the Information Resources Management Journal and MIS Quarterly articles mentioned above. Section IV offers a market analysis of our strengths and weaknesses relative to commercial IT researchers, and identifies five areas where we enjoy an advantage or can be competitive. Section V analyzes the impacts of the proposed adaptive responses for increasing relevance under each of the scenarios.


II. SCENARIOS

SCENARIO 1: MINIMAL ADAPTATION (WORST CASE)
III. PREVIOUS RESEARCH AND COMMENTARY ON RELEVANCE
The relevance issue generated a lot of attention in the latter part of the 1990s, but the concerns are not new to our field. One earlier analysis of relevance [Grover and Sabherwal, 1989] compared two research streams:
      1. The importance of specific issues to IS executives, and
      2. The frequency of publications on the same topics in leading IS research outlets


    The study found "a disconcerting gap between what the IS executives consider as important and what is actually researched." [p. 243] For example, some issues that were becomingly increasingly important to practitioners (e.g., aligning the IS organization) were receiving decreasing publication coverage in the time frame of the study. Other issues (e.g., decision support systems) continued to receive considerable research despite declining interest.

    Zmud [1996] reports a commitment at MIS Quarterly to publish research that is simultaneously rigorous and relevant. He distinguishes this approach from a "differentiated strategy" where some articles emphasize rigor and others relevance.

    Two Research Commentaries in the December 1996 issue of Information Systems Research are pertinent to relevance. Benbasat and Weber [1996] suggest that too much diversity in IS research could create problems. Robey’s [1996] response indicates that diversity is beneficial, if handled responsibly. Although relevance is not his primary focus, he argues for diversity because it increases relevance. Robey implicitly recognizes the validity of external frames of reference for research, stating: "Our constituents in the business world and our students have not demanded paradigm unification." [p. 405]

    Saunders [1998] guest-edited the Information Resources Management Journal Winter 1998 issue on "The Role of Business in IT Research." Her introductory remarks include a summary, selected on the basis of relevance to practitioner-oriented IT research, of the AACSB [1996] Faculty Leadership Task Force recommendations for business schools. Other pieces in the issue include:

      1. Pursuing practitioner sponsorship
      2. Employing alternative models for research e.g., evaluation research, policy research
      3. Producing research that is "consumable" in terms of style, story line, etc.
      4. Utilizing non-traditional publication outlets, e.g., Sloan Management Review, the business and technology press, and edited books
                                Source: Based on Lee [1999a, p. vi].


V. ANALYSIS OF IMPACTS OF ADAPTIVE RESPONSES

This section discusses the impacts of the adaptive responses I outlined under the three scenarios in Section II. Tables 1 through 3 below summarize these responses and provide an analytical framework for evaluating their impacts on our primary stakeholders: students, practitioners, and our academic peers. I provide my personal evaluations of the impacts, but readers can adapt the analysis by substituting their own evaluations.

DISCUSSION OF SCENARIO 1 IMPACTS

Under this scenario, IS researchers focus on topics where we hold a relative advantage over commercial researchers, or can be at least competitive. As with many other broadly defined research programs, this kind of research can impact stakeholders within and outside the university community both positively and negatively, as shown in Table 1.


Table 1. Impacts of Adaptive Responses Under Scenario 1


Adaptive Responses Impact on Relevance to Students Impact on Relevance 
to Practitioners
Impact on Stature within Academic Community
Focus on Relative Strengths
(applicable to all 3 scenarios)
1. Issues contrary to commercial interests slightly positive more positive than negative positive
2. Unsolved problems somewhat negative somewhat negative in short run, but positive in long term (if we can solve significant problems) positive
3. Issues economically unattractive 
to commercial researchers
strongly positive positive positive
4. Issues where management aspects are more important than technical aspects positive and negative positive and negative negative
5. Research on teaching IS strongly positive strongly positive positive and negative

 
 
Issues Contrary to Commercial Interests

For practitioners, the impact will be mixed. Exposing problems with commercial products and services will not please their suppliers. However unbiased analyses will benefit the larger category of purchasers. The impact on our students will be small but positive, if the findings translate into teaching on effective approaches to evaluating and managing IT products and services.

This type of research is consistent with the well-established tradition of social criticism in academia, and thus should enhance our stature within the community. Research in this area can also counterbalance perceptions of a "pro-industry" tilt among the other adaptive responses.

Unsolved Problems

By definition, these are problems that resisted previous efforts, and the research is not likely to generate immediate results. Therefore research on this category will not appear relevant to students or practitioners. However if we eventually succeed developing solutions for some difficult problems with high payoffs, practitioners will be more likely to recognize the value. These practitioners will include former students, who graduated long before the research yielded usable results.

These types of problems are ideal targets for theory based, methodologically rigorous, cumulative research. As such, academics in other areas will recognize the value of well-executed research on these problems.

Issues Economically Unattractive to Commercial Researchers

The impacts should be positive for all stakeholders. The external funding provides resources, research opportunities, and experience for graduate students. Some of the resources will spill over to other departments, in the form of multidisciplinary research or as hardware and software available to others. The external sponsors access sophisticated research capabilities at below-market rates, and also gain exposure to desirable employment candidates.

Issues Where Management Aspects Are More Important than Technology

The impacts for this kind of research are mixed. The further we move away from technology, the more we infringe on the turf of other academic departments such as management, marketing, and library science. Practitioners with a technical focus, undergraduate IS majors, and "techno-MBA" students will also question activities that appear to divert attention away from their strong interests in technology.

On the other hand, our association with technology could enable us to generate relevant knowledge faster or better than academics in other areas. If our findings are useful in dealing with fast-moving but critically important managerial issues (e.g., many aspects of electronic commerce), practitioners and students will quickly recognize the validity of IS research on IT management issues.

Research on Teaching IS

This kind of research should generate strongly positive impacts on both students and practitioners. To the extent the findings improve IS teaching, such research can help alleviate the well-publicized shortfall of IT workers in the US economy [US Department of Commerce, 1998], and lead to increased opportunities and better pay for our students.

In terms of relationships with other academics, the results will be mixed. On the one hand, research on teaching invades the turf of other departments. On the other hand, our experience with the technologies and contacts with IT suppliers are valuable for multidisciplinary projects, and can attract resources usable elsewhere in the university.

DISCUSSION OF SCENARIO 2 IMPACTS

Under this scenario, the leading IS journals reengineer their policies and procedures, to make the dissemination of IS research findings more consistent with the phenomena we study. Table 2 shows that the impacts on practitioners and students are uniformly positive, while the impacts on our peers in academe are mixed.


Table 2. Impacts of Adaptive Responses Under Scenario 2


Adaptive Responses Impact on Relevance to Students Impact on Relevance to Practitioners Impact on Stature within Academic Community
Reengineer IS Publishing
(also applicable to 3rd scenario)
1. Increase electronic access to journal contents positive positive mostly positive
2. Reduce review cycle times  strongly positive strongly positive depends on magnitude of reduction
3. Involve practitioners in reviews positive positive negative
4. Revise norms for style and tone strongly positive strongly positive mixed
Increase Electronic Access to Journal Contents

The impacts on stakeholders will be predominantly positive, if the journals move quickly. (Delays in making current and historical content permanently available in electronic form will reflect negatively on perceptions of our technical competence and our own understanding of the subjects we teach.) Students and practitioners recognize the tremendous benefits of electronic access and believe that all the information they want should be available online. Academics in most other fields are also under pressure to meet expectations of students and faculty for electronic access, so progress in this direction will not violate any norms6.

One possible negative concern is whether publications in completely electronic outlets will be viewed positively for tenure and promotion decisions. Arguably we should provide strong incentives for publishing in all-electronic outlets, because it is so consistent with our subject matter. On the other hand, our colleagues in other fields may disagree with high evaluations of publications in outlets with short publishing histories.

Reduce Review Cycle Times

The primary impact of faster cycles is to make it more practical for us to do research on technical issues, and on managerial issues that are important even though their life spans are relatively short. These issues are quite relevant to practitioners and students, so the secondary impact on these stakeholders should be strongly positive.

Moderate improvements in cycle times (e.g., from 30 months to 24 months) could be accomplished without major changes, and thus the impact on the opinions of our academic peers should be minimal. Large improvements would require substantial changes, however, which could negatively impact their attitudes.

As an example of the possibilities, Communications of the AIS offers authors the option of full peer review or review by an associate editor. The editor [Gray, 1999b] reports that, utilizing the latter procedure, one 75-page paper [Alter, 1999] was issued electronically 28 days after it was received.

Involve Practitioners in Reviews

Although not appropriate for all types of research, practitioner reviews will generally increase relevance to practitioners and students. Assuming that the practitioners are sufficiently distanced from the academic environment, they will be in a much better position to evaluate both relevance and readability. Our peers in other areas may be skeptical, but their grounds for opposition will be weak if IS academics handle the majority of the work on each review process that includes practitioner inputs.

Revise Norms for Style and Tone

The style and tone of a paper are a relatively small issue, seemingly much less important than its content. Nevertheless Benbasat and Zmud [1999] indicate they strongly influence a practitioner’s decision to read a paper or not. Robey and Markus [1998, p. 8] are even more emphatic, noting that "From a practitioner’s perspective, academic writings are literally unreadable."

In mid-1998, I found that the submission guidelines on the MIS Quarterly web site said I should "Avoid the use of the first person." Checking again in 1999, I found that the guidelines now stated: "Writing in the first person is acceptable, especially for qualitative, interpretive, intensive, critical, and case research." [MISQ, 1999] Supported by prominent manuals of writing style [e.g., Strunk and White, 1979], I suggest proceeding to the logical conclusion. The guidelines for journals in the IS field should not just tolerate a more direct and forceful writing style for some types of research, they should require it for all types of research. An "academic" style of writing, with extensive use the passive voice, is counterproductive. Such a style does not in any way contribute to the rigor of the contents; it just reduces accessibility to practitioners.

The adaptive response of using outside reviewers will improve readability. The adaptive response of rewarding publication in practitioner-oriented outlets (see below) could also help, because these outlets put greater emphasis on readability. Writing for such outlets will provide practice in generating more accessible content.

The impact of improving readability for practitioners will, of course, depend on the content. If the findings are not relevant, readability is a non-issue. However if the content is relevant, poor readability may prevent transferring information that could be quite helpful. If the practitioner does read it anyway, the difficulties will negatively impact his or her attitudes toward academics. The effects on students will be similar.

Our academic peers suffer through a great deal of bad writing in their own disciplines, so many will appreciate better writing. Some of the more traditional still feel that all research should be published in academese.

DISCUSSION OF SCENARIO 3 IMPACTS

This vision of the future is the most optimistic. Scenario 1 indicates a passive acceptance of existing constraints by focusing on research topics that could still be relevant within its limitations. Scenario 2 reflects changes in the publishing process to reduce the impacts of those constraints and expand the subset of relevant topics. Scenario 3 contemplates radical changes in the underlying incentive system that is ultimately responsible for the irrelevance of much of our research.

Institutional Considerations

Many of the tenure and promotion issues are not within our control as a field; they are decided at the level of the school in which the IS department is housed, or at higher levels in the larger university [King and Applegate, 1997]. However, as discussed in Section II, the universities will be facing tremendous pressures in the next 10 years that should make them more receptive to considering major changes from their traditional ways.

My call for substantial changes in the structure of academia is not unprecedented. The AACSB Faculty Leadership Task Force Report [AACSB, 1996] identifies gaps between faculty skill levels and business practices. The report includes a strategy--Improve Faculty Skill Levels--that specifically recommends changes in the tenure criteria and reward processes for business school faculty. It suggests that "quality faculty members who work hard at building linkages with industry will receive higher annual [salary] increases, more favorable promotion and tenure treatment…"

Table 3 indicates a divergence in the projected impacts. Students and practitioners will respond positively, but our academic peers will react negatively.


Table 3. Impacts of Adaptive Responses Under Scenario 3


Adaptive Responses Impact on Relevance to Students Impact on Relevance to Practitioners Impact on Stature within Academic Community
Lobby for Changes in Academia
1. Include technical competence in evaluation criteria strongly positive strongly positive strongly negative
2. Reward publishing in practitioner-oriented outlets positive positive negative
3. Involve practitioners in substantive IS program issues strongly positive positive negative
Include Technical Competence in Evaluation Criteria
Technology is central to our field and is having a tremendous impact on society throughout the world. I therefore argue that increasing academic rewards for demonstrable technical competence is the adaptive strategy that will generate the largest positive effect on our relevance to students and practitioners. However keeping up with technology requires a great deal of time and effort, which currently is not rewarded by incentive systems at most universities (Appendix).

On the other hand, directly rewarding technical competence is a radical departure from long-standing traditions in the university. The reaction from some of our peers in other disciplines will therefore be quite hostile. They may accuse us of being "technicians," even though much of the instructional content in other graduate professional schools (e.g., medicine and law) is at a technical level.

This adaptive response raises another bugaboo: many academics are finding it stressful to keep up with technologies related to the mechanics rather than the content of their teaching [HERI, 1999]. Rewarding increased technical competency for IS faculty suggests incentives or expectations for increased IT competence among faculty in unrelated disciplines.

Reward Publishing in Practitioner-Oriented Outlets

As academics we occupy a privileged position, with the opportunity to substitute research for teaching. This privilege implies a responsibility to share our research findings with the larger society in the most effective fashion. Practitioner-oriented publications offer opportunities to fulfill our obligation in ways that are not possible with academic journals. They have larger circulation, and their emphasis on readability and interest make their content much more accessible to their readers.

Based on their editorial policies, articles accepted by practitioner-focused publications will be relevant and readable. Increased publishing in this kind of outlet will therefore affect practitioner and student attitudes positively. Such publishing will also generate more exposure for IS academics, leading to better public relations and greater access to external resources.

Rewarding publications in nonacademic outlets conflicts with highly institutionalized traditions related to tenure and promotion, so the impact will be negative in the academic community. However the criticism could be reduced if publishing in practitioner-oriented outlets stimulates increased external funding for IT resources for use throughout the university.

Involve Practitioners in Substantive IS Program Issues

Increasing involvement with industry is an obvious adaptive response for increasing relevance. It suggests many obvious benefits to the university, including:

As long as the relationship is relatively one-sided, i.e. industry’s main role is supplying resources, increased involvement is not controversial. However it is unrealistic to expect outsiders to provide substantial inputs and yet exercise little influence on the use of these resources.

I argue that it is in the best interests of the IS field to allow practitioners to substantively influence IS program decisions, for the following reasons:

The most obvious type of increased involvement is sponsored courses that teach specific vendors’ software (e.g., Oracle), or teach software that coalitions of vendors sponsor (e.g., Java, Linux). Success with such intimate relationships will require a sophisticated understanding of technology management issues. However our expertise in this area should help us avoid the potential pitfalls in such relationships.

As an example of substantive industry involvement, consider the possibility of using industry inputs in tenure decisions. This would shift the rewards system toward increased relevance and greater technical competence. Table 4 shows a summary of responses to an ISWorld query asking for examples of inputs from practitioners.


Table 4. Examples of Practitioner Inputs into Tenure Decisions


Example 1:

Dean blocked respondent’s tenure decision. Several practitioners subsequently provided inputs to President, Provost, and Associate Provost, and they overruled the Dean (which was previously "unheard of" at this university).

Example 2:

One person submitted letters from practitioners in an industry association and copies of reports authored with that group. This was evidence of "scholarship of practice," which is one of the four types of scholarship considered in tenure decisions at that university.

Example 3 (respondent is at a "top 5" IS school):

Respondent knew of "at least 2 universities" that solicited letters of recommendation from senior practitioners (corporate or government positions) for people being evaluated for hiring, promotion, or tenure. 

                      Source: Condensed from Westfall [1999].
Impacts. For students, substantive industry involvement is strongly positive. It offers opportunities to learn more advanced software technologies, leading to better employment opportunities upon graduation and possible part-time work or internships while in school. The impact on practitioners will be positive, if sufficient faculty members develop the necessary technical skills to teach the sponsored technologies.

The response of academics in other areas will be increasingly hostile as industry involvement becomes more substantive. However increased access to resources for the whole university could allay some of the criticism.

VI. CONCLUSIONS

The issue of relevance is ultimately linked to our identity. Suppose that the IS field is much like other fields. Then the type of research we do, the evaluation standards, and the rewards system should be comparable to those in other fields. However if there are many prominent differences between the IS field and other fields, then our research, our standards, and our incentives should be different. We need to understand who we are.

As a "thought experiment" to explore our identity, consider the following. Neuroscientists find that subjects exhibit a negative brain wave peaking at around 400 milliseconds after exposure to a word in a sentence that is semantically inconsistent with the preceding words. The magnitude of this "N400" wave is larger when the semantic incongruity is larger [Kutas and Hillyard, 1980]. In this context, read the following statements:

  1. A truly great university needs an outstanding department of … philosophy. (This statement will probably not stimulate an N400 response.)
  2. Every university needs a department of … history. (This second statement may elicit a moderate N400 response. It is unquestionably true, but the very possibility of a university without a history department is a bit incongruous.)
Now replace the words "philosophy" and "history" with "information systems." Repeat each of the modified statements out loud, to heighten the effect. Do they strike you as more than a little incongruous? Repeat the statements out loud in the presence of academics from other fields, if you dare, and estimate the N400 responses from their facial expressions.

IS is not one of the cultural foundations of world civilization, or even western civilization. People do not come to us to discover the meaning of life or the nature of being. Students come to us because we can provide skills that will help them get good jobs, pay off their student loans, and make meaningful contributions to the organizations that hire them. Industry is happy to hire all the competent graduates we can turn out, and wishes we could supply more. If we can generate research that helps IS professionals do their work more effectively, so much the better.

Intellectual Stature

I am not saying that our field lacks intellectual respectability. As evidenced by the continuing high failure rates over many years, successfully developing and implementing large computer systems (at the extreme, the US air traffic control system [Gibbs, 1994]) is an extremely complex and challenging activity. Arguably, "Computer programs are mankind’s most elaborate artifacts." [Shore, 1985, p. 209] Any assistance we can provide in reducing the failure rate, and associated impacts, will be a noteworthy contribution to human progress7.

When people go through adolescence, they often doubt their self-worth. They compare themselves to others and emphasize their own shortcomings. They fail to recognize their strengths, and question the value of their unique abilities. This behavior is normal in adolescence, albeit painful, and can be beneficial if it helps individuals develop their own identities. On the other hand, it is sad to see--and possibly pathological--in a person past the age of 30. Our field possesses an established research tradition that Alavi et al. [1989] trace back to 1968. It is therefore time for us to exorcise the specters that are haunting us, and leave adolescent angst behind. We are who we are. Our research, and the evaluation policies that drive it, should unashamedly reflect our place in the world.

Window of Opportunity

Change is inevitable. The dynamism of the current environment represents a window of opportunity for us to influence the transformations that are undoubtedly coming.

First, we can proactively take action in areas that are under our control. The leading journals need to speed up cycle times and improve accessibility to their content. In other words, they need to operate in a mode that is consistent with the phenomena that we study. These actions will make the journals more viable outlets for research on technologies, and for research on managerial issues that are heavily influenced by the underlying technologies.

Second, we need to influence the outcome of issues that are decided by others. The extensive pressures facing the universities, in context of the revolutionary and all-encompassing societal changes driven by information technology, present a unique opportunity to communicate with decision-makers. But to act effectively, we need to recognize who we are and unhesitantly lobby for academic reforms that reflect the realities of our identity.

Or we can waste our time and energy in futile efforts to defend the status quo and hold back the onrushing tide of technology-driven changes. The window of opportunity will soon be past. Will we seize the moment, or will we yield our place to others?

END NOTES

1With apologies to James Martin for the similarity to the title of one [Martin, 1984] of his many books.

  2 Examples of this form of organization include the School of Computer Science, Telecommunications and Information Systems (CTI) at DePaul University in Chicago, and the School of Information Technology at Swinburne University of Technology in Australia.

3 These assumptions about technology and the economy also hold for the second and third scenarios.

4 To truly appreciate the rate of change, view these previous specifications in the context of the back cover of the most recent issue of PC Magazine.

5 For background on Lee’s philosophical perspectives on IS research, see Lee [1991].

6 Note that this adaptive strategy could include making materials electronically available prior to publication. See King’s [1999] report on how Information Systems Research experimented with prepublication of a research commentary by Whitman et al [1999].

7 In this regard, Leon Kappelman’s [e.g. Kappelman and Gregory, 1999] diligent efforts on the Y2K problem are certainly a credit to our community.
 

Editor’s Note: This paper was received on April 11, 1999. It was with the author 3 months for 2 revisions. It was published on September 16, 1999.
 

REFERENCES
AACSB (1996) AACSB Faculty Leadership Task Force Report, The International Association for Management Education, http://www.aacsb.edu /tfintro.html (current September 3, 1999).

AIS (1998) 1998 Americas Conference: Conference Proceedings, Baltimore, MD: Association for Information Systems, http://www.isworld.org/ais.ac.98/proceedings/home.html (current September 3, 1999).

Alavi, M., P. Carlson and G. Brooks (1989) "The Ecology of MIS Research: A Twenty Year Status Review," Proceedings of the Tenth Annual Conference on Information Systems, Boston: International Conference on Information Systems.

Alter, S. (1999) "A General, Yet Useful Theory of Information Systems," Communications of the AIS (1)13, http://cais.isworld.org/articles/1-13/article.htm (current September 3, 1999).

Applegate, L. M. and J. L. King (1999) "Rigor and Relevance: Careers on the Line," MIS Quarterly (23)1, pp. 17-18.

Beardsley, T. (1997) "In Focus: Science’s Survival Strategy," Scientific American (277)2 (August), pp. 13-16.

Benbasat, I. (1999) "Capstone Journals," in R. Weber (ed.) ISWorld Net, Community Announcements, (added May 20), http://www.commerce.uq.edu.au/ isworld/announce/msg.20-05-1999-8.html (current September 3, 1999).

Benbasat, I. and R. Weber (1996) "Research Commentary: Rethinking Diversity in Information Systems Research," Information Systems Research (7)4, pp. 389-399.

Benbasat, I. and R. Zmud (1999) "Empirical Research in Information Systems: The Practice of Relevance," MIS Quarterly (23)1, pp. 3-16.

Brancheau, J. C., B. D. Janz, and J. C. Wetherbe (1996) "Key Issues in Information Systems Management: 1994-95 SIM Delphi Results," MIS Quarterly (20)2, pp. 225-242.

Brooks, F. P., Jr. (1975) The Mythical Man-Month: Essays on Software Engineering, Reading, MA: Addison-Wesley Publishing Company.

Couger, J. D. (1996) "Creativity: Important Addition to National Joint Undergraduate I.S. Curriculum," Journal of Computer Information Systems (37)1, pp. 39-41.

CRITO (1998) "The National Science Foundation Designates CRITO One of Six Industry-University Information Technology Research Centers in the Nation," CRITO Newsletter (7)1, p. 1, http://www.crito.uci.edu/newsletters/ html/fall98.html (current September 3, 1999).

CSC (1997) Critical Issues of Information Systems Management, El Segundo, CA: Computer Sciences Corporation.

Davenport, T. (1997) "Storming the Ivory Tower," CIO (10)13 (April 15), pp. 38-41, http://www.cio.com/archive/041597_think_content.html (current September 3, 1999).

Davenport, T. H. and M. L. Markus (1999) "Rigor vs. Relevance Revisited: Response to Benbasat and Zmud," MIS Quarterly (23)1, pp. 19-23.

Davis, G. B., J. T. Gorgone, J. D. Couger, D. L. Feinstein, and H. E. Longenecker (1997) IS’97: Model Curriculum and Guidelines for Undergraduate Degree Program in Information Systems. Park Ridge, IL: Association of Information Technology Professionals, http://webfoot.csom.umn.edu/faculty/ gdavis/curcomre.pdf (current September 3, 1999).

Dennis, A. R., J. F. Nunamaker, Jr., and D. Vogel (1991) "Comparison of Laboratory and Field Research in the Study of Electronic Meeting Systems," Journal of Management Information Systems (7)2, pp. 107-135.

Dyer, J., L. Lasdon, and T. Ruefli (1998) "The Techno-MBA," OR/MS Today (25)1, pp. 32-36, http://lionhrtpub.com/orms/orms-2-98/techno.html (current September 3, 1999).

Edberg, D. T. and B. J. Bowman (1996) "User-Developed Applications: An Empirical Study of Application Quality and Developer Productivity," Journal of Management Information Systems (13)1, pp. 167-185.

Gibbs, W. W. (1994) "Software’s Chronic Crisis," Scientific American (271)3 (September), pp. 86-95.

Glass, R. L. (1997) "Practical Programmer: Revisiting the Industry/Academe Communication Chasm," Communications of the ACM (40)6, pp. 11-13.

Goodhue, D. L., L. J. Kirsch, J. A. Quillard, and M. Wybo (1992) "Strategic Data Planning: Lessons from the Field," MIS Quarterly (16)1, pp. 11-34.

Gray, P. (1999a) "Communications of the Association for Information Systems," in R. Weber (ed.) ISWorld Net, Community Announcements, (added January 8), http://www.commerce.uq.edu.au/ isworld/announce/msg. 15-01-1999-2.html (current September 3, 1999).

Gray, P. (1999b) "Publishing, Reviewing, and Related Issues," in R. Weber (ed.) ISWorld Net, Community Announcements, (added May 15), http://www.commerce.uq.edu.au/isworld/announce/msg.15-05-1999-1.html (current September 3, 1999).

Grover, V. and R. Sabherwal (1989) "An Analysis of Research in Information Systems from the IS Executive’s Perspective," Information and Management (16)5, pp. 233-46.

HERI (1999) "An Overview of the 1998-99 Faculty Norms," Higher Education Research Institute, University of California, Los Angeles, http://www.gseis.ucla.edu/heri/Faculty_Overview.html (current September 3, 1999).

Hitt, L. M. and E. Brynjolfsson (1996) "Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value," MIS Quarterly (20)2, pp. 121-142.

Ives, B. (1993) "Editor’s Comments: Cycle-Time Reduction for Disseminating Scholarly Research," MIS Quarterly (17)2, pp. xxi-xxiii.

Ives, B. (1998) "Conclusions," The Information Systems Shuttle: A Proposal for Collaborative Learning and Research, ISWorld Net Virtual Meeting Center, http://ww2.cis.temple.edu/isworld/vmc/April98/ives/sld009.htm (current September 3, 1999).

Ives, B. (1999) "Response to Joseph Williams’ Essay: The Emperor Has No Clothes," in R. Weber (ed.) ISWorld Net, Community Announcements, (added April 22), http://www.commerce.uq.edu.au/isworld/announce/msg.22-04-1999-14.html (current September 3, 1999).

Ives, B. and S. L. Jarvenpaa (1996) "Will the Internet Revolutionize Business Education and Research?" Sloan Management Review (37)3, pp. 33-41.

Jarvenpaa, S., K. Knoll, and D. Leidner (1998) "Is anybody Out There? Antecedents of Trust in Global Virtual Teams," Journal of Management Information Systems (14)4, pp. 29-64.

Kappelman, L. and C. Gregory (1999) Y2K Endgame Strategies: Risk Management, Testing, and Contingency Planning, Chicago: Society for Information Management (SIM) International.

Kavan, C. B. (1998) "Profit through Knowledge: The Application of Academic Research to Information Technology Organizations," Information Resources Management Journal (11)1, pp. 17-22.

Keene, P. G. W. (1980) "MIS Research: Reference Disciplines and Cumulative Traditions," in E. R. McLean (ed.) Proceedings of the First International Conference on Information Systems, Philadelphia: International Conference on Information Systems, pp. 9-18.

Khosrowpour, M. (ed.) (1999) Annals of Cases on Information Technology Applications and Management in Organizations (Vol. 1), Hershey, PA: Idea Group Publishing.

King, J. L. (1999) "Editorial Notes," Information Systems Research (10)2.

King, J. L. and L. M. Applegate (1997) "Crisis in the Case Study Crisis: Marginal Diminishing Returns to Scale in the Quantitative-Qualitative Research Debate," in A. S. Lee, J. Liebenau and J. DeGross (eds.) Information Systems and Qualitative Research, London: Chapman & Hall, pp. 28-30, http://www.hbs.edu/applegate/cases/research/paper.html (current September 3, 1999).

Kutas, M. and S. A. Hillyard (1980) "Reading Senseless Sentences: Brain Potentials Reflect Semantic Incongruity," Science (207)4427 (January 11), pp. 203-205.

Lacity, M. C. and R. Hirschheim (1993a) Information Systems Outsourcing: Myths, Metaphors and Realities, New York: John Wiley & Sons, Inc.

Lacity, M. C. and R. Hirschheim (1993b) "The Information Systems Outsourcing Bandwagon," Sloan Management Review (35)1, pp. 73-86.

Lederer, A. L. and V. Sethi (1988) "The Implementation of Strategic Information Systems Planning Methodologies," MIS Quarterly (12)1, pp. 445-461.

Lee, A. S. (1991) "Integrating Positivist and Interpretive Approaches to Organizational Research," Organization Science, (2)4, pp. 342-365.

Lee, A. S. (1999a) "Inaugural Editor’s Comments," MIS Quarterly (23)1, pp. v-xi.

Lee, A. S. (1999b) "Rigor and Relevance in Information Systems Research: Beyond the Approach of Positivism Alone," MIS Quarterly (23)1, pp. 29-34.

Lee, A. S. (1999c) "The Timeliness of Publications in MIS Quarterly," in R. Weber (ed.) ISWorld Net, Community Announcements, (added May 6), http://www.commerce.uq.edu.au/isworld/announce/msg.06-05-1999-1.html (current September 3, 1999).

Lyytinen, K. (1999) "Empirical Research on Information Systems: On the Relevance of Practice in Thinking of IS Research," MIS Quarterly (23)1, pp. 25-28.

Mandviwalla, M. (1998) "Internet Development," in R. Weber (ed.) ISWorld Net, Community Announcements, (added June 2), http://www.commerce. uq.edu.au/isworld/announce/int_dev.html (current September 3, 1999).

Mandviwalla, M. and P. Gray (1998) "Is IS Research on GSS Relevant?" Information Resources Management Journal (11)1, pp. 29-37.

Martin, J. (1984) An Information Systems Manifesto, Englewood Cliffs, NJ: Prentice-Hall, Inc.

MISQ (1999) "MISQ Archivist: Information for Prospective Authors," http://www.misq.org/roadmap/standards.html (current September 3, 1999).

Moore, G. E. (1965) "Cramming More Components on Integrated Circuits," Electronics (38)8 (April 19), pp. 114-117.

Motorola University (1998) "Motorola University: Learning Services: Training Open to You," http://www.mot.com/MU/LS/index.html (current September 3, 1999).

Palvia, S. (1998) "JITCA--Journal of IT Cases and Applications," in R. Weber (ed.) ISWorld Net, Community Announcements, (added June 7), http://www.commerce.uq.edu.au/isworld/announce/msg.06-07-1998-5.html (current September 3, 1999).

Panko, R. R. (1998) "What We Know About Spreadsheet Errors," Working Paper, Honolulu: College of Business Administration, University of Hawaii, http://www.cba.hawaii.edu/panko/papers/ss/whatknow.htm (current September 3, 1999).

PonTell, S., P. Gray, M. L. Markus, and R. D. Westfall (1996) "The Demand for Telecommuting," in R. T. Watson and R. P. Bostrom (eds.) Proceedings of the Telecommuting ‘96 Conference, Jacksonville, FL: The Barnett Institute of the University of North Florida, http://www.terry.uga.edu /mis/TC96/papers/gray.pdf (current September 3, 1999).

Raiffa, H. (1968) Decision Analysis: Introductory Lectures on Choices Under Uncertainty, New York: McGraw-Hill, Inc.

Robey, D. (1996) "Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility," Information Systems Research (7)4, pp. 400-408.

Robey, D. and M. L. Markus (1998) "Beyond Rigor and Relevance: Producing Consumable Research about Information Systems," Information Resources Management Journal (11)1, pp. 7-15.

Saunders, C. (1998) "Editorial Preface: The Role of Business in IT Research," Information Resources Management Journal (1):1, pp. 4-6.

Savitz, E.J. (1994) "Magellan Loses its Compass," Barron’s (84)50 (December 12), p. 35.

Senn, J. (1998) "The Challenge of Relating IS Research to Practice," Information Resources Management Journal (11)1, pp. 23-28.

Schwartz, P. (1992) "Composing a Plot for Your Scenario," Planning Review (20)3, pp. 4-8, 46.

Shore, J. (1985) The Sachertorte Algorithm and Other Antidotes to Computer Anxiety, New York: Viking.

Strunk, W. and E. B. White (1979) Elements of Style (3rd ed.), New York: Allyn & Bacon.

US Department of Commerce (1998) America’s New Deficit: The Shortage of Information Technology Workers, Washington, DC: US Department of Commerce, Office of Technology Policy http://www.ta.doc.gov/Reports/ itsw/itsw.pdf (current September 3, 1999).

US News & World Report (1999) "National Universities: Top 50," U.S. News & World Report, Inc. http://www.usnews.com/usnews/edu/ college/rankings/natunivs/natu_a2.htm (current September 3, 1999).

Watson, H., K. P. Taylor, G. Higgins, C. Kadlec, and M. Meeks (1999) "Leaders Assess the Current State of the Academic IS Discipline," Communications of the AIS (2)2, http://cais.isworld.org/articles/2-2/  (current September 3, 1999).

Westfall, R. D. (1997) Remote Work: The Demand for Telecommuting, unpublished doctoral dissertation. Claremont, CA: Claremont Graduate School (abstract at http://www.cyberg8t.com/westfalr/dis_abst.html )(current September 3, 1999).

Westfall, R. D. (1998) "Evaluation and Assimilation Skills As Key Knowledge Aspects Of Information Technology Literacy," Irvine, CA: National Research Council, Computer Science and Telecommunications Board, Workshop on What Everyone Should Know about Information Technology http://www.cyberg8t.com/westfalr/it_litrc.htm (current September 3, 1999).

Westfall, R. D. (1999) "Practitioner Involvement in Tenure Processes," in R. Weber (ed.) Archive of Research Information Solicited via ISWorld, (added December 21, 1998), http://www.commerce.uq.edu.au/isworld/research/msg.21-12-1998-3.html (current September 3, 1999).

Whitman, M. E., A. R. Hendrickson, and A. M. Townsend (1999) "Academic Rewards for Teaching, Research, and Service: Data and Discourse," Information Systems Research (10)2, pp. 99-109, http://pubsonline.informs.org/ (available September 3, 1999 through guest login and subsequent links).

Williams, J. (1999) "MISQ Themed Issue," in R. Weber (ed.) ISWorld Net, Community Announcements, (added April 22), http://www.commerce.uq.edu.au/ isworld/announce/msg.22-04-1999-2.html (current September 3, 1999).

Yin, R. K. (1989) Case Study Research: Design and Methods, Newbury Park, CA: Sage Publications, Inc.

Zmud, R. W. (1996) "Editor’s Comments," MIS Quarterly (20)3, pp. xxxvii-xl.


APPENDIX

TECHNOLOGY AND THE IS ACADEMIC

As mentioned in Section IV, we may not fully recognize the implications for teaching of the explosive growth in information technology. I also question whether we understand the implications for how we evaluate faculty.

Like faculty in other departments in a research university, we do teaching and service, we do research and publish, and we need to keep up with the scholarship in our field [Whitman et al, 1999]. Keeping up with the scholarship is complicated by the multitude of reference disciplines. Other fields work with reference disciplines, e.g., psychology enjoys a long-standing and productive involvement with mathematical statistics. However I suspect that few fields are involved with as many reference disciplines as we are.

In addition, we must cope with the unique characteristics of IT. Much more than academics in other fields, we must (or should) keep up with the rapid pace of technological development1.

COUNTERPRODUCTIVE REWARDS SYSTEM

Recognizing the importance of technology, a faculty member may invest time and effort to keep up with a set of existing and new technologies on a continuing basis. Everything else being equal, this person will not be able to publish as much research--which meets the standards of our reference disciplines--as a faculty member who does not keep up with technology. Which faculty member will possess more credibility with industry? Which one will be more likely to produce research that practitioners can really use? Which one will be better able to prepare students to meet the challenges they will face in their careers? But which one will receive the greater rewards in the current academic spoils system?

The present situation "leads to opportunistic research behaviors that tend to ignore practice." [Lyytinen, 1999, pp. 25-26] One consequence of this opportunism is that many researchers are limited in their understanding of technical issues, which leads to a lack of respect from IS professionals.

CAREER LADDERS

When industry faced a similar issue, it responded by developing separate "career ladders" for technical employees [Brooks, 1975]. Some employees aspire to the excitement and challenge of management. Those with technical interests advance by enhancing their skills while remaining on the technical side.

Scenario 3 in Section II introduces the concept of technical track for IS faculty, where maintaining and enhancing technology skills is an important factor in evaluation and advancement. This approach will give us an opportunity to enhance our stature among external constituents, by "practicing what we preach" about the importance of continuing education to practitioners. It will also provide knowledge and skills that will be useful for research on the application of technology to IS education.

CERTIFICATIONS

The increasing prominence of certification programs (Novell’s CNE and Microsoft’s MCSE are well publicized, but there are many others) provides a convenient vehicle for assessing technical competence when evaluating faculty members. Although the examinations generally do not involve a lot of higher level thinking, they do require a considerable amount of knowledge of the topic. Their popularity in the employment marketplace demonstrates that many practitioners view them as an indicator of technical competence.

Because of the rapid rate of growth and change in IT, certifications are a transient indicator. To use them for evaluations, institutions would need to recognize that their value depreciates. A faculty member with a certification would need to maintain its value by passing exams on later versions of the technology, or by replacing it with a certification in a newer technology.

Up-to-date certifications can increase our credibility with our external constituencies. Those who acquire them can expect opportunities to teach certification courses, typically at the undergraduate level. They will also be able to provide up-to-date and relevant information to students in other courses. The certifications are widely accepted and well-respected in industry, and therefore provide additional opportunities to enhance our reputation among practitioners.

NEED FOR INCENTIVES

Exhortations to increase technical skills will not benefit our field unless we provide appropriate incentives. If we do not reward such efforts, we will continue to experience a "brain drain." Technically competent faculty are leaving academia for well-paying industry positions where they can do work that is more relevant to practice (AACSB [1996] identified this problem, although not in an IS context). Our constituents--in industry and especially students--are not blind to this deterioration in our collective technical competence. Lack of technical skills also limits the types of research that we can do, further compounding the relevance problem.

APPENDIX END NOTE
1This is possible on a representative basis, with different IS faculty keeping up with different technologies.

ABOUT THE AUTHOR
After a 26-year business career, Ralph Westfall earned a Ph.D. in Management of Information Systems from Claremont Graduate University in 1997. He teaches via physical presence at California Polytechnic University in Pomona and plans to teach remotely through distance learning technologies. He has published in Information Systems Management and Journal of Computer Information Systems, and wrote a chapter in The Virtual Workplace. He presented papers at conferences of the Association for Information Systems and Decision Sciences Institute, and was invited to participate in a 1998 National Research Council workshop on information technology literacy. His research interests include the virtual office and other forms of remote work, distance learning, information technology literacy, and applications of information technology in higher education.
Copyright ©1999, by the Association for Information Systems. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and full citation on the first page. Copyright for components of this work owned by others than the Association for Information Systems must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists requires prior specific permission and/or fee. Request permission to publish from: AIS Administrative Office, P.O. Box 2712 Atlanta, GA, 30301-2712 Attn: Reprints or via e-mail from ais@gsu.edu
 
 


EDITOR
Paul Gray
Claremont Graduate University

            AIS SENIOR EDITORIAL BOARD

Henry C. Lucas, Jr.
Editor-in-Chief
New York University
Paul Gray 
Editor, CAIS Claremont Graduate University
Phillip Ein-Dor 
Editor, JAIS
Tel-Aviv University
Edward A. Stohr
Editor-at-Large
New York University
Blake Ives 
Editor, Electronic Publications 
Louisiana State University
Reagan Ramsower
Editor, ISWorld Net
Baylor University

             CAIS ADVISORY BOARD

Gordon Davis
University of Minnesota
Ken Kraemer
University of California at Irvine
Richard Mason
Southern Methodist University 
Jay Nunamaker 
University of Arizona
Henk Sol
Delft University
 Ralph Sprague
University of Hawaii

          CAIS EDITORIAL BOARD

Steve Alter
University of San Francisco
Barbara Bashein
California State University
Tung Bui
University of Hawaii
Christer Carlsson 
Abo Academy, Finland
H. Michael Chung 
California State University
Omar El Sawy 
University of Southern California
Jane Fedorowicz
Bentley College
Brent Gallupe
Queens University, Canada
Sy Goodman 
University of Arizona
Chris Holland 
Manchester Business School, UK
Jaak Jurison 
Fordham University
George Kasper 
Virginia Commonwealth University
Jerry Luftman 
Stevens Institute of Technology
Munir Mandviwalla 
Temple University
M.Lynne Markus 
Claremont Graduate University
Don McCubbrey 
University of Denver
Michael Myers
University of Auckland, New Zealand
Seev Neumann Tel Aviv University, Israel Hung Kook Park 
Sangmyung University, Korea
Dan Power 
University of Northern Iowa
Maung Sein 
Agder College, Norway
Margaret Tan 
National University of Singapore,Singapore
Robert E. Umbaugh
Carlisle Consulting Group
Doug Vogel 
City University of Hong Kong, China
Hugh Watson 
University of Georgia
Dick Welke 
Georgia State University
Rolf Wigand 
Syracuse University
 Phil Yetton 
University of New South Wales, Australia

            ADMINISTRATIVE PERSONNEL

Eph McLean 
AIS, Executive Director
Georgia State University
Colleen Bauder Cook
Subscriptions Manager
Georgia State University
Reagan Ramsower
Publisher, CAIS
Baylor University