EMC Crashes when I try to open a network folder

[flexmcmurphy]

ZGemma H7S
I previously used OpenATV 6.4 for about 5 years now switching to OpenATV 7.5.1

I used Autofs to set up a mount to a folder on a USB HDD that is attached to a Raspberry Pi.

# nano /etc/auto.master
/- /etc/auto.network --ghost

# nano /etc/auto.network
# This uses auto-fs to automount the 4tb1 drive attached to Ubuntu-Pi to /media/ubuntu in Zgemma
/media/ubuntu -fstype=cifs,rw,noperm,credentials=/home/root/creds,iocharset=utf8 ://192.168.1.34/4TB1

In the EMC I can browse to /media/ubuntu and I get a listing of directories, most of them I can browse fine but the one I really need is the directory with my movie collection. When I use the OK button on the remote to try and go in to that movie directory the box crashes. Log is attached.

There is another question on this forum that sounds similar to my problem. It was suggested that there might be non utf8 characters in file names. I'm not sure but I don't think this is my problem because this movie list I am trying to load in EMC is the same list that OpenATV 6.4 has no trouble loading in to EMC. And as you can see I am using "iocharset=utf8" in the mount options.

Maybe there is some setting I need to check in the EMC settings?

Any help much, appreciated.

Danke.

Flex

[Papi2000]

It might be the same reason in all the topics you have already read. There will be a non-UTF8 character in one of the filenames.
That is exactly the difference of the used py2- and py3-libs in the images.
Then the mount is not suported in that way. You use cifs via [autofs], but not the standard /media/autofs/ubuntu.
Your mount should look like

# nano /etc/auto.network
# This uses auto-fs to automount the 4tb1 drive attached to Ubuntu-Pi to /media/ubuntu in Zgemma
ubuntu -fstype=cifs,rw,noperm,credentials=/home/root/creds,iocharset=utf8 ://192.168.1.34/4TB1

Then some parts of the mounting system in E2 (it's NOT comparable to a full linux!) are working as expected, and the mount will be found in
/media/autofs/ubuntu

Then you can try to see the content:

Code: Alles auswählen

ls -la /media/autofs/ubuntu > /tmp/ubuntu_share.log

That file as Attachment to your post.

By the way, you will have problems with mounting with your commandline in auto.network.
Your network browser will fail, and the share management will not work.

[HowTo] Bei Netzwerk- / Verbindungsproblemen lesen und beachten (Summary): viewtopic.php?t=55079

[flexmcmurphy]

Hi,

I changed my autofs to mount the way you suggested:

-- /etc/auto.master
/media/autofs /etc/auto.network --ghost

-- /etc/auto.network
ubuntu -fstype=cifs,rw,noperm,credentials=/home/root/creds,iocharset=utf8 ://192.168.1.34/4TB1


Then...
# ls -la /media/autofs/ubuntu/movie > /home/root/files3.txt

When I open that file in notepad++ it is utf-8 encoded and I don't see any problematic characters in the whole file.

When I ssh in to the Zgemma and try this command it doesn't report any funny characters either:
# grep -axv '.*' files3.txt

I have attached the files3.txt to this message. Can you check please if there are any non utf-8 characters in the file names?

Thank you,

Flex

[Papi2000]

That content also looks good.
If you still have problems, you could do one last test.
You have your mounting concept with credentials refering to /home/root/creds.
There might be user and password referenced. You also set an extra parameter "noperm".

...
-- /etc/auto.network
ubuntu -fstype=cifs,rw,noperm,credentials=/home/root/creds,iocharset=utf8 ://192.168.1.34/4TB1
...

I would suggest, to give that way for the "/etc/auto.network" a try:

Code: Alles auswählen

ubuntu -fstype=cifs,user=root,pass=here_your_password,rw,iocharset=utf8,vers=2.0 ://192.168.1.34/4TB1

Background: Mounting in E2 is not 100% compatible to the mounting in linux. Additional or chaged parameters may damage the functionality. So omit "noperm".
And you have to adjust the "pass=..." and "vers=2.0" ("vers=1.0", "vers=2.0", "vers=3.02") to your needs. What your system still is missing the GUI-part (/etc/enigma2/automounts.xml) for beeing complete in E2 - but the mounting at start is working correct without that for starting the tests.

[flexmcmurphy]

Hi,

Thanks for your help.

I changed /etc/auto.network to this...

Code: Alles auswählen

ubuntu -fstype=cifs,rw,user=myuser,pass=mypass,iocharset=utf8,vers=2.0 ://192.168.1.34/4TB1

When I test manually it works:

Code: Alles auswählen

root@zgemmah7:~# automount -f -v
Starting automounter version 5.1.9, master map auto.master
using kernel protocol version 5.02
reading files master auto.master
mounted indirect on /media/autofs with timeout 5, freq 2 seconds
ghosting enabled
attempting to mount entry /media/autofs/ubuntu
mounted /media/autofs/ubuntu

When I use the EMC it works to browse other directorys from that HDD (samba share) but when I try to browse the movie folder it crashes still. So in other words nothing has changed, I don't think making those changes to /etc/auto.network made any difference.

Maybe there are too many files in there and the box is running out of memory? Also, the password does have the @ character in it. But surely that is not a problem?

I can do some more tests with less movies in the directory and maybe adding them back one by one and see if it works even with ONE movie.

Any other suggestions would be great. Thank you.

Flex

[Papi2000]

You have changed access to myuser - that will work, for I also have other usernames on my shares.
Password with unquoted character "@" I can't test, because I don't have such high complex security inhouse (just to avoid errors).
The amount of files should not be a topic, for we test with many and less amounts.



For example a typical file-list:

Code: Alles auswählen

C:\>dir \\ProLi03\hdd1\Filme\MKV\*.mkv
 Datenträger in Laufwerk \\ProLi03\hdd1: ist hdd1
 Volumeseriennummer: D616-D9E2

 Verzeichnis von \\ProLi03\hdd1\Filme\MKV

02.06.2018  22:17     4.236.387.064 10 Cloverfield Lane (2016).mkv
18.03.2024  18:47     8.337.277.201 16 Blocks (2006).mkv
17.04.2024  22:35     4.726.438.824 1917 (2019).mkv
27.10.2011  10:41    11.015.224.193 21 (2008).mkv
28.03.2024  21:05     4.525.223.835 21 Bridges (2019).mkv
24.03.2024  21:19     3.971.251.268 211 - Cops under Fire (2018).mkv
27.03.2020  16:09     1.946.553.285 4-3-2-1 (2010).mkv
08.09.2008  14:31     8.588.027.497 7 Sekunden (2005).mkv
20.03.2024  21:55     5.750.365.232 7 Zwerge - Der Wald ist nicht genug (2006).mkv
16.11.2009  15:05     6.011.424.211 7 Zwerge - Männer allein im Wald (2004).mkv
07.03.2024  03:13     2.904.398.471 7 Zwerge 2 - Der Wald ist nicht genug (2006-1).mkv
26.03.2024  00:34     4.357.456.277 70 Binladens (2018).mkv
28.03.2024  21:13     7.651.247.386 A Good Person (2023).mkv
22.03.2024  02:39     4.877.808.380 A Haunting in Venice (2023).mkv
13.03.2024  02:04     9.022.539.494 A Perfect Getaway (2009).mkv
11.03.2024  22:12    14.500.017.565 A Sound of Thunder (2005).mkv
18.01.2019  07:29     3.597.543.033 Ab durch die Hecke (2006).mkv
...
...
15.02.2023  19:10    17.489.202.315 Und täglich grüßt das Murmeltier (1993).mkv
30.11.2021  23:38     2.890.184.100 Undercover Blues - Ein absolut cooles Trio (1993).mkv
19.01.2019  17:08     2.909.263.915 Upgrade (2018).mkv
29.03.2024  01:22     6.182.924.871 Vacation - Wir sind die Griswolds (2015).mkv
23.03.2012  13:34    16.772.227.703 Van Helsing (2004).mkv
22.03.2024  01:07     6.913.528.726 Vanguard - Elite Special Force (2020).mkv
08.11.2017  01:57     3.585.754.976 Vendetta - Alles was ihm blieb war Rache (2017).mkv
30.01.2021  18:57     7.399.136.268 Vergiftete Wahrheit (2019).mkv
21.04.2018  12:41     2.126.419.883 Verleugnung (2016).mkv
04.04.2024  13:00     1.615.642.643 Verlorene (2019).mkv
13.11.2024  13:37    17.525.601.338 Vierzig Wagen westwärts (1965).mkv
05.03.2024  19:37     7.317.611.748 Vierzig Wagen westwärts (MGM).mkv
11.09.2013  13:16     9.382.742.230 Virtuosity (1995).mkv
29.03.2024  01:36     7.041.606.981 Voll abgezockt (2013).mkv
24.09.2021  21:02     6.351.426.301 War of the Wizards (2009).mkv
11.03.2024  00:55     6.752.921.599 Wasabi - Ein Bulle in Japan (2001).mkv
02.08.2021  16:56     4.651.423.226 Wehrlos - Die Tochter des Generals (1999).mkv
22.01.2023  12:43     4.186.742.393 White Elephant - Der Mafia Kodex (2022).mkv
30.03.2024  00:22     4.531.918.802 Wild at Heart (1990).mkv
04.05.2017  02:46     4.113.360.599 Wild Card (2015 Extended).mkv
22.05.2021  10:17     4.487.091.113 Willy's Wonderland (2021).mkv
30.12.2013  18:31    12.944.377.074 Wir sind die Millers (2013).mkv
19.05.2018  09:00     4.412.638.529 Wunder (2017).mkv
12.04.2011  05:48     7.232.028.757 Yogi Bär (2010).mkv
08.05.2019  00:50     2.016.629.249 Ziemlich beste Freunde (2011).mkv
25.03.2024  19:49     2.172.594.456 Zombieland (2009).mkv
25.03.2024  19:57     9.481.379.011 Zombieland 2 - Doppelt hält besser (2019).mkv
05.12.2021  20:35     3.721.754.024 Zone 414 - City of Robots (2021).mkv
             539 Datei(en), 3.473.932.901.652 Bytes
               0 Verzeichnis(se), 38.683.947.008 Bytes frei

That is a filtered *.mkv list. To each *.mkv, there is one *txt, one *.jpg and one *.mkv.cuts.
So in the diectory there are 539 x 4 = 2.156 files in sum to filter and examine for the right sorting in the list-view.

[flexmcmurphy]

I found the problem.

I began by symlinking the movie recordings from my "movie" folder into another folder "movie2".
Then with repeated tests I tried to open "movie2" in the EMC.

Since all my recordings use the enigma2 format I could symlink an entire year of recordings at a time.

Code: Alles auswählen

ln -s "/media/4TB1/movie/20201223"* /media/4TB1/movie2

In this way I narrowed it down to 2020 then to Dec 2020 then to 23rd of Dec 2020 and these are the files I had on that date:

Code: Alles auswählen

20201223 1017 - BBC Two - Jane Eyre (2011).eit
20201223 1017 - BBC Two - Jane Eyre (2011).ts
20201223 1017 - BBC Two - Jane Eyre (2011).ts.meta
20201223 1017 - BBC Two - Jane Eyre (2011).ts.cuts
20201223 1017 - BBC Two - Jane Eyre (2011).ts.ap
20201223 1017 - BBC Two - Jane Eyre (2011).ts.sc

Nothing wrong with those file names?

I took a look inside the .ts.meta file and it looked like this:

There was a funny (?non-utf-8) character in the movie name...
--> Jane Eyre�(2011)

I have no idea how it got there. Anyway I deleted that and saved the .ts.meta file and now my movie directory finally loads in EMC in OpenATC 7.5.1!

My movie list definitely loads more slowly in OpenATV 7.5.1 compared with OpenATV 6.4.
It takes maybe 3-4 seconds longer for the movie list to load and appear in the EMC screen.

Are there other reports of OpenATV 7.5.1 being a bit more laggy compared with earlier versions?

Thanks,

Flex

[Papi2000]

Thanks for sorting out. It is like all other cases having same trouble. And one bad character again was the reason.
And yes, the opening of the lists is a little slower, than in the past.
For me the system at all is sometimes laggy - menus, lists, browsing in recording lists or service lists...
Works fast for two pages or six to eight lines, then hangs one or two seconds, and then continues moving the mark.
The reason is complete refactoring of the code, and maybe little misallignement of the task-levels, so that background-tasks may interfere bad. The oATV6.4 based on over twelve years old finetuned code, while starting from oATV7.x stepwise refactoring of one code-module after another takes place. Sometimes starting from scratch. It feels, like we will have to wait for about another two or three years to see, what functions are left, and how these interact. Then recode missing functions, and at the end finetune again. It will be busy times.