... technologies.1
This effort responds and conforms to the requirements of ABET's EC2000 model. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... graduates.1.1
Interviewers of our graduates (whether they hire them or not) can provide especially good feedback regarding the degree to which we've achieved our targeted outcomes. For instance, we could send surveys to Deganit Armon, Tim Jenkins, Dana Salem, who interviewed UCR graduates for Advatech Pacific. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... discrepancy.1.2
ABET does not insist that there be no discrepancy. Rather, ABET insists that we have in place an effective, well-documented formal mechanism for detecting and responding to discrepancies. FIX: this needs a reference. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... graduation.1.3
The term ``outcome'', as it is used here and in ABET documents, is an eliptical usage and refers to a ``targeted outcome''. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... graduation.1.4
The term ``outcome'', as it is used here and in ABET documents, is an eliptical usage and refers to a ``targeted outcome''. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... students.1.5
We consider computer science an engineering profession, which is why it is housed in our engineering college. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... mankind.1.6
Many definitions of engineering use such phrases as ``for the benefit of mankind'' or ``to solve human problems'' or ``to fill human needs''. But weapons are engineered to kill people, and killing each other is not a benefit of mankind, a problem to be solved, or a need to be filled. Perhaps a more appropriate phrase would be ``to achieve human purposes''. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... etc.1.7
Like any other software, those formal expressions of designs are subject to version control, linkage with the designs expressed by other members of the design team, dynamic and static checking and analysis. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... software.1.8
So, why aren't they called ``software engineers''? They aren't called ``software engineers'' for the same reason that the previous generation of engineers, whose output consisted mostly of written reports, weren't called ``writers''. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... programs.1.9
When designs are expressed in detail in a formal notion with well-defined semantics, the expression of the design is high-level code and programs (compilers) can be written that translate those designs into code and/or hardware of whatever level, all the way to generating masks for the production of integrated-circuits (e.g., ASIC chips). 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... irrelevant.1.10
With the advent of robotics, stereo lithography, and numerically controlled machines, many aspects of the fabrication of mechanical-systems designs can be similarly automated. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... cutting.1.11
Quote F.T. Baker's article on Chief Programmer Teams. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... achieved.1.12
In its web page entitled ``Lessons Learned'', ABET advises: ``Have unique Program Outcomes, total reliance on outcomes a-k usually indicates taking the `easy way out'.'' 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... practiced:1.13
Engineers design, implement, validate and deploy subsystems (i.e., components) for larger systems. Understanding the surrounding system, its goals, requirements and architecture is absolutely essential. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... needs.1.14
Society at large is a stakeholder (often unrepresented) in any engineering project. It is essential that engineers understand and consider needs such as the need to protect the health and safety of the population and the sustainability of the environment. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... including:2.1
The normal course evaluations are a personnel matter, and should not be part of this system. There may be other communications of a sensitive nature that should be excluded and/or given tightly controlled access. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... asignments.2.2
TAs get 20hrs of work plus 4 units of credit, which counts for another 12 hours/week, for their efforts. They should be doing every assignment. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... school.2.3
www.ucr.apb says that 96% of UCR students are in the upper 10% of their high-school class. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... in.2.4
The Department's networked copier provides duplex 600-dpi scanning at 30 pages per minutes, which is more than sufficient to capture all work that is turned in on paper. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... evaluations:2.5
We should have functioning report generators by the end of Fall '03, which means that we need to be collecting data for The Archive by the beginning of Fall '03. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... met.2.6
See $<$http://www.wpi.edu/Academics/Depts/BioMedEng/ABET/app2b.pdf$>$. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... data.2.7
Every time we assess a student, we assess our instruction. Even an entrance exam establishes a base line by which to determine the intended increases in competence. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... students.2.8
A particular student's slice of The Archive will be called his/her ``portfolio''. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... advising,2.9
A school district in Texas is using such information to anticipate drop-outs and to intervene (http://www.chron.com/cs/CDA/ssistory.mpl/front/2019686). 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... difficulty,2.10
This situation awareness on the part of instructors will make our instruction more personal. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... section.2.11
It's easy for organized groups to gain advantages by recording the questions on exams that are generated from a pool of recycled questions and given asynchronously. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... captured.2.12
Limitations on the number of concurrently available machines force on-line exams to be asynchronous. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... place.2.13
In face, many savvy teachers already going to the effort of make paper copies of each exam before returning the originals to the students. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... student.2.14
Look at a product called Turing's Craft (www.turingscraft.com) for ideas and/or possible adoption. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... paper.2.15
Paper documents containing student work are shredded as soon as they have been scanned. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... OKI,2.16
http://web.mit.edu/oki/proj/index.html 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... system.2.17
See http://www.sleepycat.com/products/xml.shtml. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... speakers.2.18
For a tutorial on XPath see www.zvon.org/xxl/XPathTutorial/Output/example1.html. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... section.2.19
To assist in preparing these grade reports, there will be mechanisms to automatically populate a spreadsheet from a roster, to generate the per student/item report for a given assignment/quiz, and to install the results of such per-instrument reports into the section's spreadsheet. Items that are automatically graded get reported automatically. Students' performance on hand-graded items can be reported via keystrokes, mouse clicks, or mark-sense entries on graded papers. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... purposes,2.20
For each item, the faculty must somehow specify a list of targeted outcomes that this item is designed to teach/assess. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... items.2.21
Note that we also need to store the letter-grade cutoffs for purposes of renormalization, per the report of the Committee on Instruction, Appendix D.2 on page [*]. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... assessment.2.22
Once the item bank(s) are built, assessments will consist of a header plus a list of references to items in the item banks. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... (LMSs).2.23
For details, google on ``sourceforge.net'' and ``Open Knowledge Initiative''. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... clarity.2.24
Sometimes I vary its statement to so that it won't read quite the same as last time to confuse students who try to mindlessly memorize the answers to questions on previous tests. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... OKIspeak)2.25
In OKIspeak, ``assignment'' refers to the work of evaluating assessments. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... handout).2.26
Assignments posted to the web should be announced by (URL) on the section's mailing list. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... process:4.1
An excellent resource on testing is $<$http://kcc.cc.sd.us/WebPage/hb/stuperf.html$>$. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... vanity.4.2
Competition is vanity-related pressure and can be very productive as an motivation to learn. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... answer''.4.3
Question: When geese fly in a V-formation, why is one arm of the V usually longer than the other? Answer: Because there are more geese on that side. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... tables.4.4
The local Indian casinos no doubt employ people with such expertise. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... surfing''4.5
Shoulder surfers operate on the principle of ``When in doubt, look about.'' 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... exam.4.6
Cameras hidden in cellphones, baseball caps, pens, neckties, books, buttons, etc. are available for $200 -- see spytown.com. Also, several ex-students I've talked with claim that they and some of their friends have had no difficulty remembering 25 questions. THP 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... accomplished.4.7
It is often suggested that if the question bank is sufficiently large to have complete coverage of a course's material, then to know the answers to the questions in the bank is to know the course's material. Nevertheless, I know people who have passed real-estate and pilots exams that way, without learning much about real estate or flying. THP 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... half.4.8
The fact that questions tend not to be repeated within any given test (marginally) increases the coverage of the fraternity's book. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... labs4.9
There are always questions as to who does the unproctored work. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... deadlines.4.10
I have less concern about the softness of deadlines than about the substitutability of take-home work for in-lab work. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... fun,5.1
We've determined that making assignments fun is sufficient motivation for nearly all students, but we don't know how to make all assignments fun. We've considered bringing in coaches from The Comedy Store to coach our lecturers on adding a level of interest to their lectures and to deal with hecklers. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... debates5.2
According to Peter Froehlich there as a segment on ``60 Minutes'' about a school system that significantly decreased their drop-out rate and improved learning by instituting a debate program. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... pair-programming).5.3
It's my impression that when we had fewer machines and had to assign two students to a workstation, we had better results from our labs. Titus has done some recent experiments that seem to support that impression. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... competition.5.4
It's my vague impression, unsupported by data, that statistically women prefer the slot machines, while men prefer the gaming tables. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... efforts:A.1
I include them here because they are too good to lose. I'll eventually transfer them to another document. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... eachB.1
Some more challenging assignments were worth 30 points 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
...$10\%$B.2
linearly, no compounding. Thus a submission one week early would be out of $20\%$ more (24 points for a regular assignment, 36 for a challenging one). 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... earlyB.3
The workload equivalent of about two regular CS 14 courses. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... terminologyB.4
Many grading systems are isomorphic to this one, including giving no bonus points for early submission, having a set penalty per week, and making all assignments due at the beginning of the quarter, which is extreme but more likely to result in students diving into assignments early on 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... challengingB.5
Only two of the Spring 2002 assignments are viewable, but there is reference to two others even though their content is unknown. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... studentsB.6
Which may be true in the summer, where bets are off due to small class sizes and high numbers of people repeating failed courses 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... late.C.1
My worksheet is online at [http://www.cs.ucr.edu/ aadi/demo1.html]. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... quarter.D.1
This appendix is a report by CS&E's Committee on Instruction: Michalis Faloutsos, Eamonn Keogh, and Frank Vahid (chair). 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... scale.D.2
For example, the piecewise-linear transformation, where for example a raw score that is 70% of the way up the B-to-A segment of the raw-score scale yields a conventional score of 87. THP 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
... (90\%).D.3
Actually, an A-. 
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.