25 replies to this topic

[Tempel]

I figure it deserves its own post: I fixed distPND to no longer rely on run_setup. I found a hacky solution in this old mailing list thread; they all seem to agree that run_setup is generally poor and should be avoided. The latest commit in my develop branch has the fix, so reinstall distPND from there and RedNotebook will build.

[quartercast]

I figure it deserves its own post: I fixed distPND to no longer rely on run_setup. I found a hacky solution in this old mailing list thread; they all seem to agree that run_setup is generally poor and should be avoided. The latest commit in my develop branch has the fix, so reinstall distPND from there and RedNotebook will build.

Thanks so much, I will try it tonight

[Esn]

Ok... I downloaded this and installed it by opening a terminal in its directory (using Thunar file browser) and typing "sudo python setup.py install". Then I navigated to the directory of the Python program I'm hoping to port, opened a terminal and typed in "python setup.py --command-packages distpnd bdist_pnd"

I got the following:

Traceback (most recent call last):
  File "setup.py", line 50, in <module>
    from cx_Freeze import setup, Executable
ImportError: No module named cx_Freeze

What did I do wrong?

[Tempel]

You did absolutely nothing wrong. The problem lies in the setup script. Many setup scripts are very simple; all of mine contain a single call to the setup function, and nothing else. But they are full Python programs, and can be arbitrarily complex.

It looks like this setup script you have expects to find cx_Freeze, used to turn Python scripts into standalone executables. A potential solution is just to install cx_Freeze in the same manner you installed distPND: just download and unpack the cx_Freeze source, navigate to its directory, and run "python setup.py install". But if that isn't enough to get your PND working, direct me to the program you're trying to port. Then I can take a look at its setup script to see what other tricks it might be trying to pull.

Good luck!

[Esn]

Thanks... I'm not sure that installing cx_Freeze worked as it should have. Here's a copy+paste of the terminal:

Spoiler

esn-openpandora:/media/mmcblk0p1/sources/cx_Freeze-4/cx_Freeze-4.2.3$ python setup.py install
adding base module named StringIO
adding base module named UserDict
adding base module named _abcoll
adding base module named abc
adding base module named base64
adding base module named codecs
adding base module named copy
adding base module named copy_reg
adding base module named encodings
adding base module named encodings.aliases
adding base module named encodings.ascii
adding base module named encodings.base64_codec
adding base module named encodings.big5
adding base module named encodings.big5hkscs
adding base module named encodings.bz2_codec
adding base module named encodings.charmap
adding base module named encodings.cp037
adding base module named encodings.cp1006
adding base module named encodings.cp1026
adding base module named encodings.cp1140
adding base module named encodings.cp1250
adding base module named encodings.cp1251
adding base module named encodings.cp1252
adding base module named encodings.cp1253
adding base module named encodings.cp1254
adding base module named encodings.cp1255
adding base module named encodings.cp1256
adding base module named encodings.cp1257
adding base module named encodings.cp1258
adding base module named encodings.cp424
adding base module named encodings.cp437
adding base module named encodings.cp500
adding base module named encodings.cp737
adding base module named encodings.cp775
adding base module named encodings.cp850
adding base module named encodings.cp852
adding base module named encodings.cp855
adding base module named encodings.cp856
adding base module named encodings.cp857
adding base module named encodings.cp860
adding base module named encodings.cp861
adding base module named encodings.cp862
adding base module named encodings.cp863
adding base module named encodings.cp864
adding base module named encodings.cp865
adding base module named encodings.cp866
adding base module named encodings.cp869
adding base module named encodings.cp874
adding base module named encodings.cp875
adding base module named encodings.cp932
adding base module named encodings.cp949
adding base module named encodings.cp950
adding base module named encodings.euc_jis_2004
adding base module named encodings.euc_jisx0213
adding base module named encodings.euc_jp
adding base module named encodings.euc_kr
adding base module named encodings.gb18030
adding base module named encodings.gb2312
adding base module named encodings.gbk
adding base module named encodings.hex_codec
adding base module named encodings.hp_roman8
adding base module named encodings.hz
adding base module named encodings.idna
adding base module named encodings.iso2022_jp
adding base module named encodings.iso2022_jp_1
adding base module named encodings.iso2022_jp_2
adding base module named encodings.iso2022_jp_2004
adding base module named encodings.iso2022_jp_3
adding base module named encodings.iso2022_jp_ext
adding base module named encodings.iso2022_kr
adding base module named encodings.iso8859_1
adding base module named encodings.iso8859_10
adding base module named encodings.iso8859_11
adding base module named encodings.iso8859_13
adding base module named encodings.iso8859_14
adding base module named encodings.iso8859_15
adding base module named encodings.iso8859_16
adding base module named encodings.iso8859_2
adding base module named encodings.iso8859_3
adding base module named encodings.iso8859_4
adding base module named encodings.iso8859_5
adding base module named encodings.iso8859_6
adding base module named encodings.iso8859_7
adding base module named encodings.iso8859_8
adding base module named encodings.iso8859_9
adding base module named encodings.johab
adding base module named encodings.koi8_r
adding base module named encodings.koi8_u
adding base module named encodings.latin_1
adding base module named encodings.mac_arabic
adding base module named encodings.mac_centeuro
adding base module named encodings.mac_croatian
adding base module named encodings.mac_cyrillic
adding base module named encodings.mac_farsi
adding base module named encodings.mac_greek
adding base module named encodings.mac_iceland
adding base module named encodings.mac_latin2
adding base module named encodings.mac_roman
adding base module named encodings.mac_romanian
adding base module named encodings.mac_turkish
adding base module named encodings.mbcs
adding base module named encodings.palmos
adding base module named encodings.ptcp154
adding base module named encodings.punycode
adding base module named encodings.quopri_codec
adding base module named encodings.raw_unicode_escape
adding base module named encodings.rot_13
adding base module named encodings.shift_jis
adding base module named encodings.shift_jis_2004
adding base module named encodings.shift_jisx0213
adding base module named encodings.string_escape
adding base module named encodings.tis_620
adding base module named encodings.undefined
adding base module named encodings.unicode_escape
adding base module named encodings.unicode_internal
adding base module named encodings.utf_16
adding base module named encodings.utf_16_be
adding base module named encodings.utf_16_le
adding base module named encodings.utf_32
adding base module named encodings.utf_32_be
adding base module named encodings.utf_32_le
adding base module named encodings.utf_7
adding base module named encodings.utf_8
adding base module named encodings.utf_8_sig
adding base module named encodings.uu_codec
adding base module named encodings.zlib_codec
adding base module named genericpath
adding base module named linecache
adding base module named os
adding base module named posixpath
adding base module named quopri
adding base module named repr
adding base module named stat
adding base module named stringprep
adding base module named struct
adding base module named traceback
adding base module named types
adding base module named warnings
running install
running build
running build_py
creating build/lib.linux-armv7l-2.6
creating build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/dist.py -> build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/freezer.py -> build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/finder.py -> build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/windist.py -> build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/__init__.py -> build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/hooks.py -> build/lib.linux-armv7l-2.6/cx_Freeze
copying cx_Freeze/main.py -> build/lib.linux-armv7l-2.6/cx_Freeze
running build_ext
building 'cx_Freeze.util' extension
creating build/temp.linux-armv7l-2.6/source
arm-angstrom-linux-gnueabi-gcc -march=armv7-a -mtune=cortex-a8 -mfpu=neon -mfloat-abi=softfp -D__SOFTFP__ -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/include/python2.6 -c source/util.c -o build/temp.linux-armv7l-2.6/source/util.o
unable to execute arm-angstrom-linux-gnueabi-gcc: No such file or directory
error: command 'arm-angstrom-linux-gnueabi-gcc' failed with exit status 1
esn-openpandora:/media/mmcblk0p1/sources/cx_Freeze-4/cx_Freeze-4.2.3$

There seem to be some errors at the end, concerning arm-angstrom-linux-gnueabi-gcc.

The program still acts like it's not installed (I'll say what program it is if I get really stuck; I'm just trying to motivate myself to learn how this coding stuff works first).

[Tempel]

Consider that cx_Freeze is designed to turn a Python script into a standalone binary executable (and that's what it does to itself when it installs). To do so, it needs to compile something. So it's complaining that it can't find a compiler. Since I'm way too into Python, I don't know how to install one on a Pandora, but I've seen instructions around.

But it might be easier to just modify the setup script so that it doesn't it doesn't bother compiling with cx_Freeze. The Python scripts should be able to run without compilation, though they might be faster when compiled. I'm not sure exactly what would need to be changed; the "from cx_Freeze import..." line will need to be replaced with "from distutils.core import setup", and there is probably a line starting with "executables = ..." that would need to be replaced with "scripts = ...". But if you're not familiar with distutils or Python, this might be a challenge, depending on how complicated the setup script is.

But I'd still like to look at the code of the program you're porting so I can figure out why they had to use cx_Freeze, and if there's anything I need to change about distPND to work with it. I promise I won't offer any assistance unless you ask .

[Esn]

Well, of course, I'm just following instructions IKEA-style; I'm hoping that if I follow enough of them successfully, I'll eventually figure out a little about how things work. This seems like it's more complex, though, so I can't do it with the instructions I know right now.

If you do manage to get things to work, please tell me what you did, so I can use the info for next time! (or tell me what to do, that works too)

The program is called EasyABC; it's a musical notation program that uses the text-based notation from http://abcnotation.com

Here are the contents of its setup.py file:

Spoiler

# setup.py
from distutils.core import setup
import sys
import glob
import os.path

version = '1.3.0'
options = {}
executables = []

include_files = [os.path.join('locale', 'sv', 'LC_MESSAGES', 'easyabc.po'),
                 os.path.join('locale', 'sv', 'LC_MESSAGES', 'easyabc.mo')] + \
                 glob.glob(os.path.join('img', '*.*')) + glob.glob(os.path.join('sound', '*.*'))

if sys.platform == "darwin":
    import py2app
    import bdist_mpkg
    buildstyle = 'app'
    options["py2app"] = {"argv_emulation" : True,
    #                     'iconfile'       : "editor_icon.icns",
        #                 'optimize'       : 1,  #2
                         'compressed'     : 0,
                         'excludes': ['Tkinter','tcl','tk','_ssl', 'email'], 
                         'includes': ['mechanize', 'urllib', 'socket', 'pygame.pypm' ],
                            
                         }
    data_files = [('.', ['abc2midi_osx', 'abcm2ps_osx', 'abc2abc_osx', 'generalmidi.txt', 'reference.txt']),
                  ('img', glob.glob(os.path.join('img', '*.*'))),
                  ('sound', glob.glob(os.path.join('sound', '*.*'))),
                  ('locale', []),
                  ('locale/sv', []),
                  ('locale/sv/LC_MESSAGES', glob.glob(os.path.join('locale/sv/LC_MESSAGES/*'))),                  
                  ]
    
    setup(name="EasyABC",
      version=version,
      description = "ABC Editor and Converter",
      long_description = "Nils Liberg's EasyABC 1.3 RC1",
      url='http://www.nilsliberg.se/ksp/easyabc/',
      author='Nils Liberg',      
      options=options,
      data_files=data_files,
      #executables=executables,
      **{buildstyle : [{'script' : 'easy_abc.py',
                     'icon_resources' : [(0, 'img\\logo.ico')]}
                       ]}
      )

else:
    from cx_Freeze import setup, Executable
    base = "Win32GUI"
    icon = 'img\\logo.ico'
    include_files = include_files + \
                    ['abc2midi.exe',
                     'abcm2ps.exe',
                     'midi2abc.exe',
                     'abc2abc.exe',
                     'generalmidi.txt',
                     'reference.txt',
                     'Microsoft.VC90.CRT\\Microsoft.VC90.CRT.manifest',
                     'Microsoft.VC90.CRT\\msvcm90.dll',
                     'Microsoft.VC90.CRT\\msvcp90.dll',
                     'Microsoft.VC90.CRT\\msvcr90.dll',]
    options["build_exe"] = {'excludes': ['Tkinter','tcl','tk','_ssl', 'email'],   #, 'numpy.linalg.lapack_lite',  'numpy.random.mtrand.pyd', 'numpy.fft.fftpack_lite.pyd'],
                        'includes': ['mechanize', 'urllib', 'socket', 'win32api', 'win32process'],
                        'optimize': 1,
                        'include_files': include_files, }

    executables = [Executable(
        script="easy_abc.py",
        base=base,
        icon=icon,
        copyDependentFiles = True,
        appendScriptToExe = False,
        appendScriptToLibrary = False,
    )]
    
            
    setup(name="EasyABC",
          version=version,
          description = "ABC Editor and Converter",
          long_description = "Nils Liberg's EasyABC",
          url='http://nilsliberg.se/ksp/easyabc/',
          author='Nils Liberg',      
          options=options,
          executables=executables,      
          )

Edited by Esn, 09 June 2011 - 03:40 AM.

[Tempel]

Yep, this looks like you skipped IKEA and wandered into a carpentry class. Take a look at the using_EasyABC_in_Linux.txt file: between that and the setup.py file, it looks like this wasn't designed to be installed in the traditional Python way of which distPND takes advantage; it only uses the setup script to create Windows and Mac binaries. Furthermore, it has a couple dependencies, abcm2ps and wxPython, which you have to get working first.

If you're intent on turning this into a PND, first make sure you can get it running on your Pandora as-is. Then, for purposes of being thorough and learning, try manually assembling it (and its dependencies) into a PND. Only after that would it be a good idea to try to modify setup.py to use distPND.

[Esn]

A carpentry workshop, more like. Are there any instructions I can look at to learn how to do those things you're suggesting (1. getting it to run on the Pandora "as is", 2. getting those dependencies working, 3. manually assembling all that into a PND)?

[Tempel]

Ah, that's the right analogy! Anyway, those three steps will require a bunch of disparate knowledge, so I doubt it could be picked up all in one place.

First, getting the dependencies working simply requires looking over their sites to find instructions on how to build and install. You'll need standard development tools (like a compiler) to make that happen. Check around the boards and wiki to find out how to get that installed on your Pandora (and I hope you're booting from SD to fit it all). It looks like abcm2ps follows the common "./configure; make; make install" pattern (this seems like some straightforward info on that), while wxPython has its own build script. Getting these working will probably be the trickiest part.

Second, running EasyABC without installing should be really simple. As long as the dependencies are installed, you can follow the instructions in using_EasyABC_in_Linux.txt, which basically boils down to running "python easy_abc.py" from inside its source directory. If errors appear, I expect them to be caused by issues with the dependencies; read those errors to figure out what might be wrong with them.

Third, making a PND from working software isn't too difficult. Everything you need to know is on the wiki (PND quickstart says most of what you need to know, you might need to look over the PXML spec, and the libpnd hub contains a lot more detail that you probably won't need just yet). The process mainly involves putting all the files you need (including dependencies and a PXML) into a folder, then running pnd_make.sh on that folder. Of course, if you have any trouble on this step, lots of people in this forum can help.

But if you'd rather just package up something quickly and painlessly, a lot of software on the Python Package Index should work with distPND with almost no problem at all. Maybe you can find an interesting game there.

[Esn]

Tempel, thank you very much for pointing me in the right direction. I've had some problems so far that don't have anything to do with Distpnd, so I'm going to start a separate thread in the next few days to ask about those (once I'm back on my normal computer and can type quicker). Overall, I have to say that opkg on the Pandora doesn't work as it should because the two-year-old firmware isn't compatible with the feed it uses, so doing such work on the Pandora can be difficult.