Canvas 13.0 won't import course

Bugger... I hoped that might have worked...

Judging by the errors I'm guessing that the QTI converter is already installed but not where the docs say it 'should' be... Looks like it might be in /var/www/canvas/vendor/plugins/qti_exporter/lib/qti/

Sorry for leading you astray... I have no further ideas without installing and sitting down and having a play with it. Not sure when I'll have time for that. I'll see what I can do...

Thanks for your patience and sorry that I couldn't help as easily as I might have hoped...

PS FWIW I have created another (new) issue

You nailed it -- Thanks!

I'm running this on a VM using VirtualBox so I Just hiked up the memory and it actually did a partial import.

First I tired just importing a single quiz (QTI .zip from the current hosted Canvas production version). The error was:

---------------------------------------------------------------------
#23 Can't export QTI without the python converter tool installed.

category: content_migration
created at: 2014-07-17 15:28:03 -0600

  Can't export QTI without the python converter tool installed.

        /var/www/canvas/vendor/plugins/qti_exporter/lib/workers/qti_worker.rb:10:in `perform'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/backend/base.rb:211:in `invoke_job'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:135:in `block (2 levels) in perform'
/usr/local/lib/ruby/1.9.1/timeout.rb:68:in `timeout'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:135:in `block in perform'
/usr/local/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:129:in `perform'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:102:in `block in run'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:198:in `block in configure_for_job'
/usr/local/lib/ruby/1.9.1/tmpdir.rb:83:in `mktmpdir'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:196:in `configure_for_job'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:100:in `run'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:75:in `block in start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:74:in `loop'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:74:in `start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:155:in `block in spawn_worker'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:151:in `fork'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:151:in `spawn_worker'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `block (2 levels) in spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `times'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `block in spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:136:in `each'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:136:in `spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:98:in `start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:51:in `run'
/var/www/canvas/script/delayed_job:5:in `<main>'
---------------------------------------------------------------------

so, perhaps is is as simple as installing the "python converter". Any guidance on that?

Next I did a full course export/import.

It seemed to copy the assignments, pages, and calendar events, and files too. But the calendar events, while appearing in the syllabus, did not show on the calendar itself. The quizzes did not import.

It threw a lot of Canvas migration errors:

--------------------------------------------------------------

Warnings:

--------------------------------------------------------------

But, the files did import!

Most of them seem like the same problem:

#27 No such file or directory - /var/www/canvas/tmp/attachment_fu/998139314q1cpiindiaq1_r11631-0.jpg.lock

#64 No such file or directory - /var/www/canvas/tmp/attachment_fu/124232531Notes Class 11631-0.pdf.lock

#72 No such file or directory - /var/www/canvas/tmp/attachment_fu/1051754650Notes Class 21631-0.pdf.lock

so maybe these were transient errors that cleared.

Overall, this is a lot closer. Thanks for the help.

James

It turns out that directory did not exist:

root@canvas canvas/vendor# pwd
/var/www/canvas/vendor
root@canvas canvas/vendor# ls -lart
total 16
drwxr-xr-x 22 www-data www-data 4096 Oct 15 14:55 plugins
drwxr-xr-x  3 www-data www-data 4096 Oct 15 14:55 bundle
drwxr-xr-x  4 www-data www-data 4096 Oct 15 14:55 .
drwxr-xr-x 19 root     www-data 4096 Oct 15 15:33 ..
root@canvas canvas/vendor# cd /

So, I followed the instructions here:

https://github.com/instructure/QTIMigrationTool/wiki

to install the migration tool.

Afterwards, the directory was fully popuplated with migrate.py marked execute. Also, the parent had correct ownership per your suggestion:

drwxr-xr-x  5 www-data www-data  4096 Feb  4 19:08 vendor

This time, when I did a quiz import, I got:

#201 Cannot allocate memory - unzip -qo /var/www/canvas/tmp/files/0000/0077/1391454086_423__global-economies-and-markets-quiz-export\%252B\%2525287\%252529.zip -d /tmp/job-780-canvas.3552-20140204-3552-i9nkv6/qti20140204-3552-11kwmq0 2>&1

Cannot allocate memory - unzip -qo /var/www/canvas/tmp/files/0000/0077/1391454086_423__global-economies-and-markets-quiz-export\%252B\%2525287\%252529.zip -d /tmp/job-780-canvas.3552-20140204-3552-i9nkv6/qti20140204-3552-11kwmq0 2>&1

/var/www/canvas/vendor/bundle/ruby/1.9.1/bundler/gems/rails-e86daf8ff727/activesupport/lib/active_support/core_ext/kernel/agnostics.rb:7:in ``'
/var/www/canvas/vendor/bundle/ruby/1.9.1/bundler/gems/rails-e86daf8ff727/activesupport/lib/active_support/core_ext/kernel/agnostics.rb:7:in ``'
/var/www/canvas/lib/canvas/migration/migrator.rb:60:in `unzip_archive'
/var/www/canvas/vendor/plugins/qti_exporter/lib/qti/converter.rb:29:in `export'
/var/www/canvas/lib/cc/importer/cc_worker.rb:33:in `perform'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/backend/base.rb:229:in `invoke_job'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:135:in `block (2 levels) in perform'
/usr/lib/ruby/1.9.1/timeout.rb:68:in `timeout'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:135:in `block in perform'
/usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:129:in `perform'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:102:in `block in run'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:199:in `block in configure_for_job'
/usr/lib/ruby/1.9.1/tmpdir.rb:83:in `mktmpdir'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:197:in `configure_for_job'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:100:in `run'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:75:in `block in start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:74:in `loop'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:74:in `start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:153:in `block in spawn_worker'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:164:in `block in fork_with_reconnects'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:161:in `fork'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:161:in `fork_with_reconnects'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:151:in `spawn_worker'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `block (2 levels) in spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `times'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `block in spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:136:in `each'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:136:in `spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:98:in `start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:51:in `run'
/var/www/canvas/script/delayed_job:5:in `<main>'
      

TBH I have no idea what this is about. I have just done a little research on the issue and it seems that it is often a result of incorrect python version (which shouldn't be an issue in TKL). Although thinking about it some more, I wonder if again it is perhaps a permissions issue? One person who had this issue mentioned that they "adjusted permissions". Unfortunately they didn't explicitly say what permissions, but that got me thinking again... According to this migrate.py needs to be executable by the Canvas process. so just to satisfy my curiosity, could you please try setting the ownership and permissions of this folder and file:

chown -R www-data:www-data /var/www/canvas/vendor
chmod +x /var/www/canvas/vendor/QTIMigrationTool/migrate.py

PS You raise a good point re version... I note that some of the other TKL appliances that come from Git state the commit number but the Canvas appliance doesn't seem to...

Success - the course import worked! Thanks Jeremy.

Not sure I should have opened up a new thread but there is just one thing that didn't work --quizzes. I tried a stand-alone import of a few quizess exported from my hosted Canvas production system. The import fails with this error:

#199 Couldn't convert QTI 1.2 to 2.1, see error log: /tmp/job-675-canvas.3384-20140203-3384-57yq22/cm_11_user_id_1_qti/qti_conversion_error.log

category: content_migration
created at: 2014-02-03 12:01:30 -0700
couldn't convert QTI 1.2 to 2.1, see error log: /tmp/job-675-canvas.3384-20140203-3384-57yq22/cm_11_user_id_1_qti/qti_conversion_error.log

/var/www/canvas/vendor/plugins/qti_exporter/lib/qti/converter.rb:77:in `run_qti_converter'
/var/www/canvas/vendor/plugins/qti_exporter/lib/qti/converter.rb:35:in `export'
/var/www/canvas/lib/cc/importer/cc_worker.rb:33:in `perform'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/backend/base.rb:229:in `invoke_job'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:135:in `block (2 levels) in perform'
/usr/lib/ruby/1.9.1/timeout.rb:68:in `timeout'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:135:in `block in perform'
/usr/lib/ruby/1.9.1/benchmark.rb:295:in `realtime'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:129:in `perform'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:102:in `block in run'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:199:in `block in configure_for_job'
/usr/lib/ruby/1.9.1/tmpdir.rb:83:in `mktmpdir'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:197:in `configure_for_job'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:100:in `run'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:75:in `block in start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:74:in `loop'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/worker.rb:74:in `start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:153:in `block in spawn_worker'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:164:in `block in fork_with_reconnects'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:161:in `fork'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:161:in `fork_with_reconnects'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:151:in `spawn_worker'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `block (2 levels) in spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `times'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:138:in `block in spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:136:in `each'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:136:in `spawn_all_workers'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:98:in `start'
/var/www/canvas/vendor/plugins/delayed_job/lib/delayed/pool.rb:51:in `run'
/var/www/canvas/script/delayed_job:5:in `<main>'

I don't suspect the production log will offer much more. It seems odd to me that the stated problem is in going from QTI 1.2 to 2.1. If anything, I would have guessed that the TKL version would have been backlevel from Instructure production. (Which raises a question for me: How do you determine the current version of Canvas -- with slipstreaming does it even offer release numbers?)

James

It seems that there is another bug in the Canvas appliance... The permissions aren't quite right. See this issue. Basically you need to adjust the permissions for the tmp folder. I would do it like this:

chown -R www-data:www-data /var/www/canvas/tmp

Thanks for the assistance Jeremy!

I applied the 3-line fix to Redis and restarted the entire server. It still could not import the course package. So, instead of the entire course, I just exported a small quiz and tried that. Still failed (i.e. browser froze and errors found in log).

Reflected in the log below, I went to import the quiz, but this time ticked off the "Select migration content" option. That froze as well:

http://filebin.ca/1AOZbmo778MY/production.log [production log]

Ths system had quiesced at line 1181. That's when I inititated the import.

The first error was at 1955:

Errno::ENOENT (No such file or directory - /var/www/canvas/tmp/attachment_fu/13621884811390833896_4__global-economies-and-markets-quiz-export%252B%2525286%2525293841-0.zip.lock):

Could that mean that the file (only 80K BTW) was read but somehow another process could not read it?

James

The current Canvas appliance needs to have a slightly later version of Redis-server than what it is packaged with (on face value it works, but actually it's a bit broken...). Have a look at the workaround here.

If you've already done that and you're still getting the same error, then perhaps there is some incompatibility between the version on your hosted instance and the TKL one?

see this thread:

/forum/support/wed-20231122-1754/canvas-fail...